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CHAPTER  I 


INTRODUCTION 

Consider  a  production  system  composed  of  many  processing  stages  (servers) 
through  which  the  material  (jobs)  must  pass  in  some  prespecified  order.  The  per¬ 
formance  of  such  a  system  is  impaired  by  variations  in  servers  behavior  due  either 
to  failures  or  to  fluctuations  in  service  times.  The  effects  of  these  variations  can 
be  mitigated  by  using  intermediate  storage  spaces  (buffers)  between  the  servers. 
However,  because  of  physical  limitations  on  buffer  spaces  and  variations  in  the  ser¬ 
vice  times,  the  flow  of  jobs  through  the  system  may  get  blocked.  Queueing  systems 
with  blocking  have  a  wider  applicability  in  that  they  can  also  be  used  to  model 
computer  systems,  telecommunication  networks  and  distributed  systems,  to  name 
a  few  applications. 

This  thesis  is  devoted  to  various  analytical  and  algorithmic  issues  for  tandem 
queueing  systems  with  blocking.  The  blocking  systems  considered  here  are  com¬ 
posed  of  a  series  arrangement  of  service  stations  with  finite  intermediate  buffers 
between  these  stations.  A  typical  tandem  configuration  is  shown  in  Figure  1.1.1. 
At  each  station  some  work  is  performed  on  a  job  which  is  then  passed  on  to  the 
next  station  and  finally  ejected  from  the  last  station.  It  is  assumed  here  that  a  sin¬ 
gle  server  which  operates  according  to  the  FCFS  (first-come-first  -served)  queueing 
discipline  is  in  attendance  at  each  station. 
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Figure  1.1.1 

The  literature  considers  two  distinct  blocking  policies  for  transfer  lines  with 
finite  buffers.  Let  S  be  one  of  the  servers  in  Figure  1.1.1.  Under  the  first  policy, 
called  immediate  blocking ,  at  a  time  of  service  completion,  the  server  S  is  blocked 
if  the  downstream  buffer  becomes  full  due  to  this  service  completion;  the  server 
S  remains  blocked  until  the  congestion  is  reduced  downstream,  at  which  time  it 
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resumes  service  and  begins  to  process  its  next  job  (if  any).  Under  the  second  policy, 
called  non-immediate  blocking,  the  server  S  is  blocked  at  a  service  completion  time 
if  the  job  that  has  just  completed  service  cannot  proceed  to  the  next  buffer  due 
to  congestion.  When  the  congestion  is  reduced  downstream,  this  job  proceeds  to 
the  next  buffer  without  receiving  any  further  service  at  server  S,  and  the  server  S 
resumes  service  and  begins  processing  its  next  job  (if  any).  As  noted  in  Altiok  and 
Stidham  [4],  these  two  blocking  policies  are  not  equivalent  in  the  sense  that  the 
solution  of  the  system  under  one  policy  cannot  be  obtained  from  the  solution  of 
the  system  (with  possibly  different  parameter  values)  under  the  other  policy,  and 
therefore  cannot  be  reduced  to  each  other,  except  when  N=2. 

Queueing  networks  with  blocking  are  typically  very  difficult  to  analyze,  and 
closed  form  results  at  steady  state  (or  otherwise)  are  usually  not  available,  except 
in  tandem  models  with  two  exponential  servers  and  a  finite  intermediate  buffer. 
This  model  is  probably  the  simplest  configuration  of  an  open  queueing  network 
with  blocking.  A  rigorous  Markovian  analysis  of  this  system  was  performed  in 
the  pioneering  work  of  Hunt  [36],  who  upon  enumerating  the  different  possible 
states  in  which  the  system  can  exist,  did  set  up  and  solve  the  equations  for  the 
state  probabilities  in  statistical  equilibrium.  Since  then,  queueing  networks  with 
blocking  have  been  studied  by  researchers  from  different  research  communities.  To 
fix  the  terminology,  a  brief  classification  of  the  blocking  systems  discussed  in  the 
literature  is  provided  in  the  Appendix,  where  an  annotated  bibliography  of  some 
of  these  papers  has  been  compiled.  A  basic  assumption  that  was  made  in  all  the 
models  studied  in  the  surveyed  literature  is  that  the  last  stage  is  never  blocked,  i. 
e.,  there  is  always  space  available  for  a  job  whose  service  has  been  completed  at  the 
last  server.  Three  classes  of  systems  have  been  studied: 

(i)  Systems  without  failures  :  In  this  class,  the  service  stations  in  Figure  1.1.1 
are  attended  by  reliable  servers.  As  long  as  there  is  a  part  to  process  and  the  server  is 
not  blocked,  it  can  always  give  service  according  to  some  known  service  distribution. 
Authors  like  Altiok  [2],  Clarke  [19,20],  Foster  and  Perros  [25],  Hildebrand  [32,33], 
Hunt  [36],  Konheim  and  Reiser  [40],  Latouche  and  Neuts  [45],  Lavenberg  [46],  Neuts 
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[54,57],  Perros  and  Altiok  [63]  and  Pinedo  and  Wolf  [64]  allow  an  infinite  capacity 
input  buffer  upstream  of  the  first  server  and  assume  jobs  to  arrive  according  to  some 
statistical  pattern.  Others,  like  Hatcher  [31],  Hillier  and  Boling  [34],  Knott  [40], 
Muth  [51,52]  and  Rao  [66],  assume  that  there  is  an  inexhaustible  supply  of  jobs  to 
the  first  server,  and  so  the  first  server  is  never  starved.  In  most  of  the  models  studied 
in  the  literature,  servers  are  assumed  to  have  exponentially  distributed  service  times. 
Exceptions  are  Hiller  and  Boling  [34]  which  allow  Erlang  distributions,  and  Muth 
[51,52]  and  Rao  [66]  who  postulate  more  general  service  time  distributions. 

(ii)  Systems  subject  to  failures  :  The  service  stations  are  attended  by  unreli¬ 
able  servers,  i.  e.,  servers  subject  to  failures  which  are  non-deterministic  in  both 
occurence  and  duration.  This  class  of  models  can  be  further  divided  into  two  sub¬ 
classes  according  to  the  assumptions  imposed  on  the  service  times. 

(ii.a)  Deterministic  processing  times  :  The  service  times  are  assumed  to  be 
deterministic  while  both  the  failure  and  repair  times  of  the  servers  are  allowed  to 
be  random.  All  the  models  discussed  in  the  literature  postulate  that  the  first  server 
is  never  starved,  and  that  the  duration  of  up  and  down  times  are  geometrically 
distributed.  Relevant  papers  include  the  work  of  Artamonov  [6],  Buzacott  [15,16], 
Buzacott  and  Hanifin  [17],  Freeman  [24],  Gershwin  and  Ammar  [27],  Gershwin  and 
Schick  [28],  Ignall  and  Silver  [37],  Masso  and  Smith  [48],  Muth  and  Yeralan  [53], 
Ohmi  [60],  Okamura  and  Yamashina  [61],  Sheskin  [68],  Soyster,  Schmidt  and  Rohrer 
[69]  and  Wijngaard  [76]. 

(ii.b)  Random  processing  times  :  Service  times  as  well  as  the  failure  and  repair 
times  are  random ,  as  the  case  in  the  work  of  Buzacott  [16],  and  Gershwin  and 
Berman  [28].  In  both  papers,  the  failure  and  repair  times  and  the  service  times 
were  assumed  to  be  exponentially  distributed.  Only  two  stages  were  considered 
with  the  assumption  that  the  first  server  is  never  starved. 

(iii)  Flow  models  :  In  this  class  of  models,  jobs  are  not  treated  as  discrete  items 
but  rather  as  a  continuous  fluid.  This  model  was  considered  in  papers  by  Buzacott 
and  Hanifin  [17]  and  Wijngaard  [76],  where  the  servers  were  subject  to  failures  with 
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deterministic  service  times  as  in  class  ii.a. 

To  the  author’s  knowledge,  the  exact  closed-form  solution  of  the  joint  queue 
length  distribution  at  steady-state  has  not  yet  been  reported  in  the  literature,  and 
this  even  in  the  simplest  of  models  under  exponential  assumptions.  One  of  the 
contributions  of  this  thesis  is  to  identify  a  class  of  two  node  tandem  systems  with 
blocking  for  which  the  joint  queue  length  distribution  at  steady-state  can  be  ob¬ 
tained  in  closed-form. 

In  this  thesis  attention  is  given  to  the  analytical  aspects  of  various  models  of 
two  node  tandem  systems.  Although  two  node  blocking  systems  may  not  constitute 
very  realistic  models  for  many  real  life  systems,  these  simple  systems  could  serve  as 
building  blocks  for  approximating  general  tandem  queueing  systems  with  blocking. 
Indeed,  many  approximation  schemes  developed  for  general  tandem  queueing  sys¬ 
tems,  e.g.,  Altiok  [1],  Brandwajn  and  Jow  [13],  Hillier  and  Boling  [34]  and  Sheskin 
[67],  to  name  a  few,  are  based  on  decomposition  and  isolation  algorithms  that  re¬ 
duce  the  problem  to  one  of  simultaneously  solving  several  simple  systems  which  are 
special  cases  of  the  models  studied  here.  Such  ideas  clearly  motivate  a  careful  study 
of  the  general  two  node  tandem  systems  with  blocking,  with  a  view  towards  pro¬ 
viding  exact  analytical  results  so  as  to  enhance  existing  and  future  approximation 
schemes. 

The  focus  of  the  work  reported  here  is  on  models  which  are  in  classes  (i)  and 
(ii.a).  As  a  rule,  the  models  presented  here  adopt  immediate  blocking  and  include 
servers  with  phase  type  (PH- type)  service  distributions.  For  the  benefit  of  the 
unfamiliar  reader,  Chapter  II  includes  a  brief  introduction  to  PH-type  distributions. 
With  the  exception  of  the  model  discussed  in  Chapter  V  where  an  an  arrival  process 
to  the  first  buffer  in  Figure  1.1.1  is  considered,  the  system  is  assumed  saturated  in 
that  the  input  queue  in  Figure  1.1.1  contains,  at  all  times,  an  infinite  supply  of  jobs, 
so  that  the  first  node  server  is  never  starved .  In  all  cases,  it  is  assumed  that  the 
server  in  the  last  node  is  never  blocked. 

In  Chapter  III,  a  two  node  tandem  system  with  an  intermediate  buffer  of  finite 
capacity  is  analyzed  when  both  servers  have  PH-type  service  distributions.  Although 
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the  discussion  focuses  on  the  discrete-time  formulation,  results  for  the  continuous¬ 
time  model  are  also  presented.  A  system  state  process  is  introduced  and  its  proba¬ 
bilistic  structure  is  carefully  described.  In  contrast  with  the  continuous-time  model, 
the  discrete-time  formulation  may  give  rise  to  a  non-irreducible  Markov  chain.  Nec¬ 
essary  and  sufficient  conditions  for  its  irreducibility  are  given,  and  its  ergodic  and 
transient  states  are  identified  in  terms  of  the  parameters  defining  the  service  dis¬ 
tributions.  Moreover,  the  steady  state  probabilities  of  the  system  states  are  shown 
to  have  a  matrix  geometric  form  and  closed  form  expressions  are  obtained  for  the 
quantities  of  interest.  The  effect  of  reversing  the  order  of  the  servers  is  discussed  and 
it  is  observed  that  in  statistical  equilibrium  the  probability  of  finding  i  customers 
in  the  buffer  in  one  case  coincides  with  finding  K  —  i  customers  in  the  case  when 
the  order  of  the  servers  is  changed,  K  being  the  buffer  capacity.  The  results  are 
illustrated  through  numerical  examples  on  some  well-known  PH-type  distributions. 

In  Chapter  IV,  the  general  model  of  Chapter  III  is  specialized  to  the  case 
where  one  of  the  servers  is  geometric.  The  discussion  focuses  on  the  situation  where 
the  first  and  second  node  servers  have  geometric  and  PH-type  service  distributions, 
respectively.  The  case  when  the  order  of  the  servers  is  reversed  is  only  briefly 
discussed,  as  the  results  follow  from  the  discussion  in  Chapter  III.  A  system  state 
process  is  introduced  and  its  probabilistic  structure  is  carefully  described.  For  this 
special  case,  it  is  shown  that  the  steady  state  probability  vector  is  always  unique 
and  a  complete  characterization  of  the  system  states  is  given  by  identifying  the 
irreducible  and  transient  states  of  the  underlying  Markov  chain.  Explicit  expressions 
for  the  steady  state  probabilities  are  obtained  and  attempts  are  made  to  give  an 
expression  for  the  average  system  throughput,  in  order  to  study  its  behavior  as  a 
function  of  the  intermediate  buffer  capacity.  The  continuous-time  formulation  of 
the  model  is  also  briefly  discussed  and  similar  results  are  obtained.  The  discussion 
on  this  particular  model  concludes  by  applying  the  results  to  some  specific  PH-type 
distributions. 

In  Chapter  V,  a  two  node  system  with  PH-type  servers  at  both  nodes  (as  in 
Chapter  III)  is  considered  by  relaxing  the  assumption  that  the  first  node  server 
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is  never  starved  to  capture  the  situation  of  a  Bernoulli  arrival  stream  to  a  finite 
capacity  queue  in  front  of  the  first  node  server.  A  system  state  is  defined  and  the 
probabilistic  structure  of  the  corresponding  process  is  described.  Neccessary  and 
sufficient  conditions  for  the  irreducibility  of  the  Markov  chain  are  obtained  in  terms 
of  the  system  parameters.  It  is  shown  that  the  steady  state  probability  vector 
is  always  unique,  and  can  be  obtained  in  closed  form  by  grouping  the  states  in 
pairs.  The  joint  queue  length  distribution  at  steady  state  is  then  easily  obtained  as 
entries  of  the  steady  state  probability  vector  of  these  auxilary  states.  Although  the 
discussion  focuses  on  the  discrete-time  formulation,  the  continuous-time  model  is 
also  discussed  and  the  irreducibility  of  the  corresponding  Markov  process  is  shown. 

In  Chapter  VI,  unreliable  servers  with  PH-type  up  and  down  time  distributions 
are  considered.  The  effective  service  time  distributions  of  such  servers  are  repre¬ 
sented  by  PH-distributions  of  higher  order.  Although  the  results  of  Chapter  III  do 
not  directly  apply  the  exact  same  methodology  can  be  used.  Specifically,  when  the 
idling  servers  are  subject  to  failure,  the  transition  probabilities  among  the  bound¬ 
ary  states  are  explicitly  written  and  a  matrix  geometric  solution  is  derived  for  the 
steady  state  probabilities  through  calculations  similar  to  the  ones  given  in  previous 
chapters.  The  case  when  only  operational  servers  can  fail  is  obtained  as  a  special 
case  of  this  discussion.  The  results  are  illustrated  by  several  numerical  examples. 

Finally,  in  Chapter  VII  an  iterative  approximation  scheme  that  uses  the  two 
node  system  as  a  building  block  is  presented  for  solving  general  tandem  queueing 
systems  with  finite  capacity  intermediate  buffers  and  PH-type  servers.  Since  the 
algorithm  is  based  on  a  two  node  system  it  is  applicable  for  both  immediate  and 
nonimmediate  blocking  since  these  two  blocking  policies  can  be  reduced  to  each 
other  for  two  node  systems  as  mentioned  earlier.  However  only  immediate  block¬ 
ing  is  considered  here.  The  approximation  algorithm  gives  results  in  the  form  of 
marginal  probability  distribution  of  the  number  of  jobs  in  each  queue  of  the  tandem 
configuration  so  that  the  line  throughput  can  be  computed.  In  view  of  the  results 
derived  in  Chapter  VI,  this  approximation  scheme  also  applies  to  failure  type  servers 
with  PH-type  service  and  repair  distributions.  The  algorithm  is  presented  and  its 

-  6  - 


accuracy  tested  through  numerical  examples  both  for  continuous  and  discrete-time 
systems,  under  both  types  of  blocking.  Comparison  of  the  results  against  simu¬ 
lations  indicate  reasonable  accuracy  even  in  the  presence  of  significant  blocking. 
Program  listings  are  available  from  the  author  upon  request. 
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CHAPTER  II 


MOTIVATION  AND  BACKGROUND 

II. 1.  Motivation  : 

The  work  reported  in  this  thesis  aims  at  understanding  the  effect  of  blocking  on 
system  performance  through  a  detailed  study  of  two  node  tandem  models.  Although 
blocking  systems  with  only  two  or  three  nodes  may  not  be  realistic  models  for  most 
applications,  they  can  be  thought  out  as  building  blocks  for  approximating  general 
queueing  networks  subject  to  blocking.  In  this  section,  a  few  examples  are  given  as 
to  how  several  authors  have  used  such  simple  models  to  approximate  more  general 
tandem  queueing  systems. 

The  first  example  is  borrowed  from  Brandwajn  and  Jow  [13],  where  the  solution 
of  a  two  node  system  is  used  as  a  building  block  for  an  approximate  analysis  of 
systems  of  tandem  queues  with  blocking.  Reliable  and  exponential  servers  with  load 
dependent  service  rates  were  considered.  The  method  uses  the  notion  of  equivalence 
to  produce  approximations  to  the  joint  queue  length  probability  distributions  for 
pairs  of  neighboring  servers  and  to  various  performance  measures  for  individual 
servers.  The  proposed  method  is  applicable  to  both  types  of  blocking  since  they  are 
equivalent  for  two  node  systems. 

The  second  example  is  from  Hillier  and  Boling  [34],  who  consider  a  general 
tandem  manufacturing  system  with  a  single  exponential  server  at  each  node  and 
finite  intermediate  buffers  between  the  nodes.  They  develop  an  efficient  algorithm 
to  compute  the  steady  state  output  rate  via  single  node  analysis.  The  effective 
mean  arrival  rate  and  the  effective  mean  service  rate  at  a  particular  node  are  ob¬ 
tained  by  considering  the  remainder  of  the  system  as  a  black  box  which  generates 
input  to  this  particular  node  and  accepts  the  output  of  this  particular  node.  Each 
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node  can  therefore  be  viewed  as  a  single  server  queueing  model  with  Poisson  input, 
exponential  service  times  and  a  finite  buffer.  This  already  suggests  that,  provided 
an  interconnection  methodology  were  available,  tandem  configurations  of  PH-type 
servers  could  be  approximated  by  several  isolated  two  node  models  of  the  type 
studied  in  Chapter  IV. 

The  third  example  comes  from  Sheskin  [68],  where  the  servers  are  subject  to 
failures.  He  studied  a  general  tandem  line  where  service  times  are  constant  whereas 
failure  and  repair  times  are  random,  i.  e.,  a  model  in  class  (ii.a)  described  earlier. 
The  transitions  between  the  up  and  down  states  of  the  servers  are  assumed  to 
occur  according  to  a  time-homogenous  Markov  chain.  For  larger  systems,  Sheskin 
proposes  to  approximate  the  system  by  analyzing  each  server  separately  by  ignoring 
the  dependence  between  the  arrivals  and  the  departures  to  a  node.  Hence,  this 
decomposition  algorithm  reduces  the  problem  to  several  simple  problems.  Due  to  the 
memoryless  nature  of  the  up  and  down  time  distributions,  the  service  distribution 
of  such  a  failure  server  can  be  represented  by  a  PH-type  distribution  with  only 
two  phases,  the  so-called  up  and  down  phases  of  the  service.  This  decomposition 
procedure  yields  simple  systems  which  are  special  cases  of  the  models  studied  here. 
It  is  noteworthy  that,  this  decomposition  algorithm  is  reported  to  approximate 
general  systems  within  5%  of  relative  error,  without  requiring  much  computer  time 
and  memory. 

The  last  example  was  considered  by  Altiok  [1],  who  studied  a  model  in  class 
(ii.b)  with  independent  Erlang  type  service  distributions,  exponential  up  times  and 
arbitrary  down  time  distributions.  Although  expressions  for  the  cumulative  distri¬ 
bution  of  service  completion  times  can  be  obtained,  they  are  very  complicated  and 
not  readily  implemented.  When  the  down  times  have  also  exponential  distribu¬ 
tions,  Altiok  proposes  to  assume  that  during  the  processing  time  of  a  job  at  most 
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one  failure  may  occur  and  uses  this  fact  to  incorporate  failures  into  the  service 
completion  times.  These  service  completion  times  are  then  approximated  by  spe¬ 
cific  PH-type  distributions  through  empirical  observations,  and  Then,  by  using  the 
results  of  Perros  and  Altiok  [63],  the  effective  service  time  distribution  of  the  ith 
server  is  represented  with  a  phase  structure  involving  2  x  (M  —  *  + 1)  phases,  where 
M  is  the  total  number  of  nodes  in  the  system.  Again,  the  model  is  approximated 
by  simple  systems  (of  the  type  studied  here)  in  isolation. 

The  last  two  examples  suggest  that  even  models  with  unreliable  servers  can  be 
approximated  by  simultaneously  solving  several  simple  models.  Since  these  models 
are  of  the  type  discussed  in  Chapter  III,  it  is  particularly  important  that  explicit 
solutions  for  such  models  be  obtained  and  that  their  algorithmic  properties  be 
discussed  in  some  detail. 

In  order  to  capture  a  fairly  general  class  of  service  time  distributions  PH- 
type  servers  are  considered.  To  fix  the  notation  and  terminology  for  the  unfamiliar 
reader  it  is  convenient  at  this  point  to  briefly  describe  properties  of  the  class  of  PH- 
type  distributions.  For  additional  information  on  this  topic  the  reader  is  invited  to 
consult  the  monograph  by  Neuts  [58]. 
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II. 2.  Phase  Type  Distributions  : 


Probability  distributions  of  the  phase-type,  denoted  by  PH-type,  were  intro¬ 
duced  both  in  discrete  and  continuous-time  by  M.F.  Neuts  [58].  Loosely  speaking, 
a  discrete-time  PH-type  distribution  is  any  probability  distribution  on  the  non¬ 
negative  integers  obtainable  as  the  distribution  of  the  time  until  absorption  in  a 
discrete-time  finite  state  space  Markov  chain  with  a  single  absorbing  state.  The 
class  of  PH-type  distributions  includes  well  known  distributions  such  as  the  Gen¬ 
eralized  Negative  Binomial  and  Hypergeometric  distributions,  as  well  as  any  dis¬ 
tribution  with  finite  support  on  the  nonnegative  integers.  The  usefulness  of  these 
distributions  to  the  algorithmic  solution  of  many  queueing  models  has  been  force¬ 
fully  advocated  by  Neuts  for  quite  some  time  now,  and  is  illustrated  in  some  detail 
in  [58].  The  reader  is  also  refered  to  [ll]  and  [55]  for  a  discussion  of  the  many 
interesting  properties  enjoyed  by  PH-type  distributions. 

Specifically,  consider  a  discrete-time  Markov  chain  on  the  state-space 
S  =  {l,,2,...,m+  1},  where  the  states  {l,...,m}  are  transient  and  the  state 
m  +  1  is  absorbing.  The  chain  starts  in  state  i  G  S  with  probability  a,-  and  evolves 
in  accordance  with  the  one-step  transition  matrix  P.  It  is  customary  to  write  the 
one-step  transition  matrix  P  and  the  initialization  probabilities  in  the  form 


*-(£  0  * (a,am+i) 
OL  (c^i ,  CX.2  >  •  •  •  > 


(2.2.1) 


where 

Q  is  a  m  x  m  substochastic  matrix, 

p  is  a  m  X  1  column  vector  of  absorption  probabilities  to  the  absorbing 
state  m  +  1  from  the  transient  states  {!,...,  m}, 
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a  is  a  1  x  m  row  vector  of  initialization  probabilities, 
0m  is  a  1  x  m  row  vector  with  zero  entries. 

The  following  relationships 


P  —  (fm  Q )  Cm  ,  &m+ 1  —  1  a  em 

obviously  hold,  where  Im  is  the  mxm  identity  matrix  and  em  is  the  m  x  1  column 
vector  of  ones. 

It  is  assumed  that  the  matrix  ( Im  —  Q )  is  nonsingular  or  equivalently,  that  the 
states  {1,2, . . .  ,m}  are  all  transient,  so  that  the  absorption  into  the  state  m  +  1, 
from  any  initial  state,  is  certain  [58,  p.  45]. 

The  PH-type  probability  distribution  associated  with  the  pair  (a,  Q )  is  the  dis¬ 
tribution  function  F(-)  on  the  non-negative  integers  with  probability  mass  function 
given  by 

(  &m+l  ,  k  —  0  , 

Qk  =  l  (2.2.2) 

l  aQk~lp  ,  k  >  1  . 

The  pair  (a,  Q)  is  called  the  representation  of  the  distribution  F,  which  it  uniquely 
determines.  The  converse  is  not  true  in  that  a  given  distribution  function  F(-) 
admits  infinitely  many  PH-representations.  The  probability  generating  function 
P(-)  of  the  PH-distribution  with  representation  (a,  Q)  is  given  for  all  0  <  z  <  1  by 


F(z)  =  !>*** 

k= 0 

=  am+ 1  ”1“  ZQ)  P 


—  &m+l  +  1  “ 


(2.2.3) 


The  following  probabilistic  construction  is  given  in  Neuts  [58,  p.  48].  Upon 
absorption  into  state  m  +  1,  independent  multinomial  trials  with  probabilities 
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(a,ctm+ 1)  are  instantaneously  and  repeatedly  performed  until  one  of  the  alterna¬ 
tives  1,2 occurs.  The  process  is  restarted  in  the  corresponding  state  and 
the  same  procedure  is  repeated  at  the  next  absorption.  It  is  easy  to  show  that 
upon  indefinitly  continuing  this  procedure,  a  new  Markov  process  is  constructed  on 
{1,2,...,  m}  in  which  the  state  m  +  1  is  an  instantaneous  state.  The  corresponding 
one-step  probability  matrix  is  readily  seen  to  be 

Q*  =  Q  +  - - - - p  a  (2.2.4) 

1  ^m+ 1 

The  successive  visits  to  the  instantaneous  state  form  a  renewal  process  with  the 
underlying  distribution  F,  called  a  PH-renewal  process.  The  representation  (o:,  Q) 
is  said  irreducible  if  and  only  if  the  Markov  chain  on  {l,...,m}  with  one-step 
probability  matrix  Q*  is  irreducible. 

As  shown  in  [58,  pp.  49-50],  every  PH-type  distribution  function  F  admits  an 
irreducible  representation,  whence  only  irreducible  representations  will  be  consid¬ 
ered  hereafter.  Moreover,  the  condition  am+i  =  0  will  be  assumed  in  order  to  avoid 
complications  of  limited  interest  in  applications.  Under  this  assumption,  it  is  plain 
that  a  ^  0m,  and  that  p  /  0^,  where  T  denotes  transposition,  for  otherwise  the 
matrix  Q  would  be  stochastic,  thus  contradicting  the  nonsingularity  assumption  of 
the  matrix  (7m  —  Q). 

To  fix  ideas,  the  representations  of  some  well-known  PH-type  distributions  are 
displayed  below;  they  will  be  used  in  the  numerical  examples  of  later  chapters.  In 
these  examples,  0  <  m  <  1  for  1  <  i  <  n. 

(t):  A  Negative  Binomial  distribution  of  order  n  is  represented  by  the  pair 
( a,Q ),  where 

cx  —  (l,0,0,...,0)  —  (l,0re_i) 


-  13  - 


and 


/  (1  —  Mi)  Mi 

(I-M2)  M2 


Q  = 


V 


(1  Mn— 1)  Mn— 1 

(1-  Mn)  y 


(2.2.5) 


(»»):  A  Hypergeometric  distribution  of  order  n  is  represented  by  the  pair  (a,  Q ), 
where 


a  =  (alya2, . . .  ,an)  and  Q  =  diag(l  -  mi»  1  -  M2,  •  .  . ,  1  -  Mn)  •  (2.2.6) 


(m):  A  Deterministic  service  time  of  n  units  is  represented  by  the  pair  (a,  Q), 
where 

&  =  (1,0,0, ...  ,0)  =  (l,0„_i) 


and 


(0  1 

0  1 


Q  = 


V 


A 


°  1 
0  ) 


(2.2.7) 


PH-type  representations  can  also  be  introduced  in  a  similar  way  for  distribu¬ 
tions  on  [0, 00).  In  this  case,  a  Markov  process  on  the  states  {1, . . .  ,m  +  1}  with 

infinitesimal  generator  (  ®  ^  )  is  considered,  where  the  m  X  m  matrix  Q  satisfies 

\  0m  0  j 

the  conditions  Qa  <  0  and  pi  >  0  for  1  <  i  <  m,  and  Qij  >0,  1  <  i  ^  j  <  m. 
Moreover,  Qem  =  —  p  and  the  initial  probability  vector  of  Q  is  given  by  (a,  am+i), 
where  a  is  defined  as  before.  It  is  again  assumed  that  the  states  {1, . . .  ,m}  are  all 
transient,  or  equivalently,  that  the  matrix  Q  is  nonsingular  [58,  p.  45]. 
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A  probability  distribution  F(- )  on  [0,oo),  is  a  distribution  of  PH-type  if  and 
only  if  it  is  the  distribution  of  the  time  until  absorption  in  a  finite  Markov  process  of 
the  type  defined  above.  In  that  case,  the  distribution  function  F(-)  can  be  expressed 
as 

F(x)  =  1  -  aexp(Qx)em  ,  z>0,  (2.2.8) 

with  a  jump  at  x  =  0  of  height  am+i  and  its  density  F'(x)  on  (0,  oo)  given  by 

F'(x)  =  a  exp(Q  x)  p  ,  s>0.  (2.2.9) 

The  pair  (a,  Q)  is  again  called  the  representation  of  the  distribution  F. 
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II. 3.  Preliminaries  : 


In  this  section,  several  definitions  and  results  of  interest  from  the  theory  of 
nonnegative  matrices  are  presented,  and  the  nonsingularity  of  several  matrices  of 
interest  for  subsequent  developments  is  proved.  The  reader  is  referred  to  Berman 
and  Plemmons  [10]  for  a  general  reference  on  the  theory  of  nonnegative  matrices. 
Throughout  the  discussion,  all  the  matrices  have  real  entries  unless  otherwise  men¬ 
tioned.  The  notation  A  >  0  is  used  whenever  each  entry  of  the  vector  or  matrix  A 
is  nonnegative  whereas  A  >  0  is  used  if  A  >  0  and  at  least  one  entry  is  positive, 
and  A  >>  0  is  used  if  all  entries  of  A  are  positive. 

Definition  2.3.1.  :  An  n  x  n  nonnegative  matrix  A  is  cogredient  to  an  n  x  n 
matrix  E  if  for  some  permutation  matrix  P,  PAPT  —  E.  The  matrix  A  is  said  to 
be  reducible  if  it  is  cogredient  to 


where  B  and  D  are  square  matrices,  otherwise,  A  is  said  to  be  irreducible. 
Definition  2.3.2.  :  The  directed  graph  G(A)  associated  with  an  n  x  n  nonneg¬ 
ative  matrix  A  is  the  graph  made  up  of  n  vertices,  say  P\,P2,. . .  Pn,  with  an  edge 
leading  from  Pi  to  Pj  if  and  only  if  Aij  >  0,  1  <  i,j  <  n. 

It  is  well  known  [10,  p.  30]  that  a  matrix  A  is  irreducible  if  and  only  if  G(A)  is 
strongly  connected ,  that  is,  for  every  ordered  pair  (Pt-,Py)  of  vertices  of  G(A),  there 
exists  a  path,  i.  e.,  a  sequence  of  edges  which  leads  from  Pt-  to  Pj.  The  following 
Lemma  is  a  simple  application  of  the  Definition  2.3.2  and  will  be  useful  in  the  proofs 
of  Theorems  4.3.2.  and  5.3.1. 

Lemma  2.3.3.  :  For  any  two  nonnegative  square  matrices  A  and  B,  the  matrix 
(A+B)  is  irreducible  if  and  only  if  the  matrix  (c\A  +  c-iB)  is  irreducible  for  all 
scalars  Ci, C2  >  0. 
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Proof  :  Owing  to  the  nonnegativity  of  the  matrices  A  and  B,  (A  +  B)ij  >  0  if  and 
only  if  (ci  A  +  c2  B)ij  >  0,  whenever  ci,  c2  >  0,  while  ( A  +  B)ij  =  0  if  and  only  if 
Aij  =  Bij  =  ci  Aij  +  c2  Bij  —  (ci  A  +  c2  B)ij  =  0  .  The  topology  of  the  directed 
graphs  G(A  +  B)  and  G{c\  A  +  c2  B),  c i,  c2  >  0,  are  thus  exactly  same,  and  the 
result  follows  by  Definition  2.3.1. 

A 

When  a  nonnegative  matrix  is  a  stochastic  one,  the  notion  of  irreducibility 
in  the  Definition  2.3.1  is  related  to  the  probabilistic  one  in  that  every  stochastic 
matrix  can  be  viewed  as  the  one-step  transition  matrix  of  a  Markov  chain.  In  order 
to  clarify  the  terminology  used  hereafter,  it  is  imperative  to  classify  the  states  of  a 
Markov  chain. 

Consider  a  finite  state  Markov  chain  with  the  state  space  S  =  {si, . . .  ,sn}. 
Definition  2.3.4.  :  If  in  the  state  transition  diagram  of  the  Markov  chain  S  there 
exists  a  path  from  state  Si  to  state  Sj,  Si,Sj  £  S,  then  the  state  Si  is  said  to  have 
access  to  state  sj,  written  Si  — >  Sj.  If  S{  has  access  to  Sj  and  Sj  has  access  to  Si, 
then  Si  and  Sj  are  said  to  communicate,  written  as  st-  *->  sj. 

Implicit  in  Definition  2.3.4  is  that  every  state  in  S  communicates  with  itself, 
and  with  this  convention,  the  communication  relation  is  an  equivalence  relation  on 
the  set  of  states  and  thus  partitions  S  into  equivalence  classes.  With  this  in  mind, 
the  following  definition  is  given. 

Definition  2.3.5.  :  A  state  Si  €  S  is  called  transient  if  there  exists  some  Sj  ^  S{ 
in  S  with  the  property  that  S{  — >  Sj  but  Sj  ■/+  st-,  that  is,  st-  has  access  to  some  other 
state  which  does  not  have  access  to  Sj.  Otherwise,  the  state  S{  is  called  ergodic. 

Thus,  Si  is  ergodic  if  and  only  if  Si  — >  Sj  implies  Sj  — >  s;  for  some  Sj  7^  S{  in  S. 
It  follows  that  if  one  state  in  an  equilance  class  of  states  associated  with  a  Markov 
chain  is  transient  (resp.  ergodic),  then  each  state  in  that  class  is  transient  (resp. 
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ergodic).  This  leads  to  the  next  definition. 

Definition  2.3.6.  :  A  class  induced  by  the  communication  relation  on  the  set  S  is 
called  transient  if  it  contains  a  transient  state  and  ergodic  otherwise. 

Definition  2.3.7.  :  A  Markov  chain  is  called  irreducible  if  it  consists  of  a  single 
ergodic  class. 

In  view  of  the  above  definitions,  the  following  Lemma  can  easily  be  proved. 
Lemma  2.3.8.  :  A  finite  state  Markov  chain  is  irreducible  if  and  only  if  the 

corresponding  one-step  transition  matrix  is  irreducible. 

Therefore,  these  two  concepts  of  irreducibility  can  and  will  be  used  interchange¬ 
ably  hereafter.  The  following  notion  of  reachability  will  be  used  repeateadly  in  later 
chapters. 

Definition  2.3.9  :  Let  U  and  V  be  subsets  of  the  state  space  of  a  Markov  chain 
with  corresponding  one-step  probability  transition  matrix  T.  The  set  U  is  reachable 
from  the  set  V  if  there  is  a  path  from  some  state  in  V  to  a  state  in  U  in  the  directed 
graph  G(T )  of  the  matrix  T. 

The  following  class  of  matrices  is  very  useful  in  many  applications. 

Definition  2.3.10  :  An  nx  n  matrix  A  is  called  an  M-matrix  if  it  is  of  the  form 
A  =  sln  —  B  for  some  s  >  0  and  B  >  0,  with  s  >  p(B),  where  p(B)  denotes  the 
spectral  radius  of  B. 

For  many  useful  properties  of  M-matrices,  the  reader  is  referred  to  [10,  Chapter 
6],  The  following  Lemma  will  be  used  in  the  proof  of  Lemma  2.3.17. 

Lemma  2.3.11  :  If  (a,Q)  is  an  irreducible  discrete  (resp.  continuous)  PH- 
representation  of  order  m,  then  the  matrix  ( Im  —  Q)  (resp.  —Q)  is  a  nonsingu¬ 
lar  M-matrix  and  its  eigenvalues  all  have  positive  real  parts. 

Proof :  It  is  well  known,  [10],  that  for  any  nxn  nonnegative  matrix  A,  the  following 
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bounds 


n  n 

<  p(-d)  <  max{^  A{j } 

i= i  *  >=1 

hold  true  for  its  spectral  radius.  When  the  matrix  A  is  stochastic,  each  one  of  its 
rows  sum  to  1,  whence  p(A)  =  1. 

Since  the  nonnegative  matrix  Q  is  substochastic,  p(Q )  <  1,  and  the  matrix 
Im  —  Q  is  an  M-matrix  by  Definition  2.3.10  (with  s  =  1  and  B  —  Q).  Furthermore, 
the  matrix  (Jm  —  Q)  being  invertible  implies  p(Q)  <  1  and  the  second  part  of 
Lemma  2.3.11  is  now  immediate:  Indeed,  (A,x)  is  a  rigth  (left)  eigenpair  for  Q  if 
and  only  if  (1  —  A,x)  is  a  right  (left)  eigenpair  for  Im  —  Q,  whence  8?e(l  —  A)  >  0 
since  —  1  <  3?e(A)  <  1,  where  SKe(x)  denotes  the  real  part  of  the  complex  number  x. 

The  Lemma  can  be  proved  in  a  similar  way  for  an  irreducible  continuous  PH- 
representation  with  s  —  —q*  and  B=  (— q*Im  +  Q ),  where  —q*  maxi<t-<m{— Qu}. 

A 

The  following  theorem  is  a  basic  result  in  the  Perron-Frobenius  theory  of  non¬ 
negative  matrices. 

Theorem  3.2.12.  :  If  A  is  an  n  x  n  nonnegative  matrix,  then 
(i)  The  spectral  radius  p{A)  of  A  is  an  eigenvalue  of  A,  and 
(ii)  There  always  exists  left  and  right  eigenvectors  with  nonnegative 
components  which  corresponds  to  p(A). 

The  invariant  probability  vector  tt  of  an  m-state  Markov  chain  with  one-step 
probability  transition  matrix  A  is  defined  as  the  lxm  vector  7r  that  satisfies 

7T  A  =  7T  ,  7Tew  =  1  . 

The  following  results  investigate  the  existence  and  uniqueness  of  the  invariant  prob¬ 
ability  vector  of  a  finite  state  Markov  chain. 
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Theorem  2.3.13.  :  Every  finite  state  Markov  chain  has  an  invariant  probability 
vector. 

Proof  :  If  the  m  x  m  matrix  A  is  the  state  transition  matrix  associated  with  the 
chain,  then  p(A )  =  1  by  Lemma  2.3.11  and  by  Theorem  2.3.12  there  exists  a  row 
vector  x  >  0  with  xA  =  x.  Normalizing  x  gives  t r  ==  (xem)_1  x  with  tv  A  =  tv  and 
7rem  =  1,  i.e.,  tv  is  an  invariant  probability  vector  of  the  chain. 

A 

Although  Theorem  2.3.13  guarantees  the  existence  of  an  invariant  probability 
vector,  it  is  not  unique  in  general.  The  next  result  investigates  the  general  form  of 
an  invariant  probability  vector. 

Theorem  2.3.14.  :  Let  S{,  1  <  i  <  r,  be  the  ergodic  classes  of  a  finite  state 
Markov  chain.  For  each  Si  there  is  a  unique  invariant  probability  vector  Tv(i)  with 
the  property  that  the  entries  of  tv(i)  corresponding  to  the  states  of  Si  are  positive 
whereas  all  other  entries  are  zero.  Moreover,  any  invariant  probability  vector  tv  of  the 
chain  can  be  expressed  as  a  linear  convex  combination  of  the  vectors  7r(z),  1  <  i  <  r, 
i.  e., 

r  r 

*  =  5^ A*  *(*)  ’  - 0 »  Xi  =  1  ■ 

i=  1  *=1 

Proof  :  See  Berman  and  Plemnons  [10,  pp.  224-225]. 

In  view  of  Theorem  2.3.14,  even  when  the  Markov  chain  is  not  irreducible,  if 
it  has  a  single  ergodic  class,  then  the  invariant  probability  vector  is  unique  with 
positive  entries  for  positions  corresponding  to  the  ergodic  class  and  zero  entries  for 
positions  corresponding  to  the  transient  states.  Note  that  the  ergodic  classes  are  de¬ 
fined  as  equivalence  classes  induced  by  the  communication  relation  as  defined  above, 
with  no  assumptions  made  on  the  (a)periodicity  of  the  Markov  chain.  Therefore, 
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in  cases  where  there  is  a  single  ergodic  class,  the  unique  invariant  probability  vec¬ 
tor  will  coincide  with  the  long-run  average  probability  vector  of  the  Markov  chain 
(  defined  in  the  Cesaro  sense). 

Next,  conditions  for  the  nonsingularity  of  several  matrices  of  interest  for  subse¬ 
quent  developments  are  established.  To  that  end,  the  Kronecker  product  of  matrices 
is  defined  and  some  of  its  properties  are  introduced. 

Definition  2.3.15  :  If  B  and  A  are  p  x  q  and  m  X  n,  rectangular  matrices,  respec¬ 
tively,  then  their  Kronecker  product,  denoted  B  <g>  A,  is  the  pm  X  qn  matrix  defined 
in  block-partitioned  form  by 

~B\\A  B12A  •••  B\qA~ 

B21A  B22A  •  •  •  B2qA 

B  ®  A  .  (2.3.1) 

.Bp\A  BP2A  •••  BpqA. 

Some  properties  of  the  Kronecker  product  are  collected  in  the  following  Lemma 
for  future  use.  The  proof  of  these  properties  and  of  other  useful  properties  of  the 
Kronecker  product  can  be  found  in  [14]. 

Lemma  2.3.16.  :  (i)  :  If  A,B,C,D  are  rectangular  matrices  such  that  the  ordinary 
matrix  products  below  are  defined,  then 


[A  ®  B)  ®  C  —  A  ®  {B  ®  C)  , 

(2.3.2a) 

(A  ®B){C  ®D)  =  AC®  BD  , 

(2.3.26) 

(A  ®  B)t  =  At  ®Bt  . 

(2.3.2c) 

(ii)  :  If  the  row  vectors  a  and  0  are  the  left  eigenvectors  of  the  m  x  m  and  n  x  n 
matrices  A  and  B  corresponding  to  eigenvalues  A  and  p,  respectively,  then  a®  0  is 
an  eigenvector  of  A®  B  with  eigenvalue  Xp  and  all  eigenpairs  of  A®  B  have  this 
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form,  whence  the  relation 


det(A  ®B)=  det{A)n  det{B)m  (2.3.2 d) 

holds,  where  det(X)  is  the  determinant  of  the  matrix  X. 

Let  the  pairs  (a.  A)  and  (/ 3,B )  be  two  irreducible  discrete-time  PH-represen- 
tations.  The  row  vectors  a  and  0  and  the  matrices  A  and  B  have  dimensions 
lx/,  lxm,  l  x  l  and  m  x  m,  respectively,  and  the  corresponding  l  x  1  and  mxl 
column  vectors  of  absorption  probabilities  are  denoted  by  a  and  b,  respectively.  The 
(/  m  X  /  m)  matrices  M  and  N  are  now  defined  by 

M  :=  Im  ®  ( Ii  —  ei  a)  +  B  ®  (ei  a  —  A)  (2.3.3a) 

N  :=  {Im  -  em  0)  ®  h  +  (em  0  -  B)  ®  A,  (2.3.36) 

respectively.  Conditions  for  the  nonsingularity  of  the  matrices  M  and  N  are  now 
given.  To  that  end,  let  C  be  the  open  disc  centered  at  (0.5,0)  in  the  complex  plane 

with  radius  0.5  and  let  S'p(.X')  denote  the  spectrum  of  the  matrix  X.  The  following 

result  gives  a  sufficient  but  not  necessary  condition. 

Lemma  2.3.17.  :  If  Sp{B)  C  C  (resp.  Sp[A)  C  Cj  then  the  matrix  M  (resp.  N) 
defined  by  (2.8.8)  is  nonsingular. 

Proof  :  Let  5Ke(x)  again  denote  the  real  part  of  the  complex  number  x.  The  lemma 
is  proved  only  for  M  as  nonsingularity  of  N  follows  along  the  same  lines.  Since  the 
matrices  (Ij  —  A)  and  (Jm  —  B)  are  nonsingular,  Lemma  2.3.16  allows  a  rewriting 
of  the  matrix  M  in  the  form 

M  —  Im  <S>  {I i  —  A)  +  (Jm  —  B)  <g>  {A  —  e;  a) 

=  [Im  ®  {h  ~  A)]  D  [{Im  -  B)  <g>  h] 

where 

D  —  (Im  ~  B)-1  ®h  +  Im  <S>  [h  -  A)-1  {A  -eia)  . 
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This  clearly  shows  that  M  is  nonsingular  if  and  only  if  the  matrix  D  is  nonsingu¬ 
lar.  By  Lemma  2.3.16  again,  each  eigenvalue  of  the  matrix  D  is  the  sum  of  the 
eigenvalues  of  the  matrices  ( 7m  —  -B)-1  and  (7*  —  A)-1  (A  —  ei  a).  By  assumption, 
it  is  an  easy  exercise  to  check  that  the  eigenvalues  of  (7m  —  7?)-1  have  real  parts 
strictly  greater  than  one,  and  the  matrix  D  is  thus  invertible  if  the  real  parts  of  the 
eigenvalues  of  the  matrix  (/;  —  A)-1  (A  —  ei  a)  are  greater  than  or  equal  to  -1. 

The  proof  will  be  completed  by  showing  that  if  7  G  Sp  [(//  —  A)-1  {A  —  e/  a)] , 
then  9?e(q)  >  —1.  The  argument  proceeds  by  contradiction  and  assumes  3Re(7)  < 
—1.  If  y  denotes  the  corresponding  right  eigenvector,  then 

{Ii  —  A)~~l  Ay  —  (ay)  (Ii  —  A)~l  ei  =  7  y  ,  (2.3.4) 

and  therefore  ay  ^  0,  for  otherwise  the  second  term  on  the  left  hand  side  of  (2.3.4) 
drops  and  adding  y  to  both  sides  then  yields 

(7/  +  (7/  -  A)-1  A)  y  =  (Ii  -  A)-1  y  =  ^y  +  y 

and  therefore  (7  +  1)  G  Sp  [(7;  -  A)-1]  and  5ie(7  +  1)  >  0  by  Lemma  2.3.11,  thus 
contradicting  the  assumption  that  9ie(7)  <  —  1. 

Since  ay  7^  0,  assume  without  loss  of  generality  that  ay  =  1  and  note  from 

(2.3.4)  that  —7  7{  —  (i±2)  A  y  —  ei.  The  assumption  Re(q)  <  —1  implies  ^3-  < 
1,  whence  ^7 1  —  (^±1)  A^  is  invertible.  The  relation 

y  =  -  [7 7|  -  (1  +  7)  A]-1  ei 


Equations  (2.3.5)  and  (2.2.3)  combine  to  yield 


1  +  7 
7  , 


=  1 


-w 


a 


7 


[1  +  7 


h-A 


-l 


ei  =  0 


where  P(-)  is  the  probability  generating  function  of  the  PH-representation  (a,  .A). 
The  condition  5ie(7)  <  —1  means  0  <  <  1>  and  the  probability  generating 

function  of  a  non-negative  random  variable  being  strictly  positive  in  the  right  half¬ 
plane,  it  thus  follows  by  contradiction  that  5Re( 7)  >  —1. 

A 

It  should  be  noted  that  for  many  interesting  discrete  PH-type  distributions 
such  as  Erlang  or  hypergeometric  distributions  the  eigenvalues  of  the  associated  Q 
matrix  as  given  by  (2.2.5)  and  (2.2.6),  respectively,  satisfy  the  conditions  of  Lemma 
2.3.17. 


The  following  corollary  is  an  immediate  consequence  of  this  last  proof. 
Corollary  2.3.18.  :  The  matrix  M  ( resp .  N)  is  singular  if  the  matrix  B  (resp.  A) 
is  singular. 

Proof  :  The  matrix  B  being  singular,  A  =  1  is  an  eigenvalue  of  (Jm  —  J9)-1  that 
corresponds  to  eigenvalue  A  =  0  for  B,  while  (— l,e/)  is  a  right  eigenpair  for  the 
matrix  (/;  —  A)~l  ( A  —  ei  a).  Therefore,  zero  is  an  eigenvalue  of  the  matrix  D  defined 
above,  whence  the  matrix  D  is  singular  and  so  is  the  matrix  M. 

A 

Similarly,  let  the  pairs  (a,  A)  and  (/?,  B)  be  two  irreducible  continuous-time 
PH-representations.  The  row  vectors  a.  and  /?  and  the  matrices  A  and  B  have 
dimensions  lxl,  lxm,  l  X  l  and  m  x  m,  respectively,  and  let  the  corresponding 
l  x  1  and  m  X  1  column  vectors  of  absorption  probabilities  be  again  denoted  by  a 

and  b,  respectively.  The  (l  m  x  l  m)  matrices  M  and  N  are  now  defined  by 

M  B  ®  (Ii  —  ei  a)  +  Im  <g>  A  (2.3.6a) 
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N  :=  (7m  -  em0)  <g>  A  +  B  <g>  Ix  , 


(2.3.66) 


respectively. 

Lemma  2.3.19.  :  The  matrices  M  and  N  defined  by  (2.3.6)  are  nonsingular. 
Proof  :  The  Lemma  is  proved  only  for  N  as  the  nonsingularity  of  M  follows  along 
the  same  lines.  With  a  similar  line  of  thoughts  as  in  the  proof  of  Lemma  2.3.17,  the 
matrix  N  can  be  rewitten  as 

N  —  (B  ®  Ii)  [ B -1  ( Im  -  em  /?)  ®  Ii  +  Im  <g>  ^_1]  (Jm  <g>  A) 

Since  the  matrices  A  and  B  are  invertible,  it  follows  from  the  second  part  of  Lemma 
2.3.6  that  the  matrices  ( B®fi )  and  (Jm  ®  A)  are  both  invertible,  whence  N  is  invert¬ 
ible  if  and  only  if  the  matrix  \B~X  (Im  —  em  (3)  ®  It  +  Im  ®  A-1]  is  invertible.  Note 
from  Lemma  2.3.11  that  A  has  eigenvalues  with  strictly  negative  real  parts,  therefore 
to  show  the  nonsingularity  of  N,  it  suffices  to  show  that  if  7  €  Sp[B~x  (Jm  —  ew  /?)], 
then  Sfi!e(7)  <  0.  That  this  fact  holds  true  follows  by  arguments  similar  to  the  ones 
given  in  the  proof  of  Lemma  2.3.17,  and  the  matrix  N  is  thus  invertible. 

A 

Finally,  the  well-known  Gerschgorin  Circle  Theorem  is  stated  here  for  easy 
reference  in  later  chapters. 

Theorem  2.3.20.  :  Let  X  be  an  nxn  complex  matrix.  Define 

n 

n(x)  :=  \Xij\  1  <  *  <  n  , 

y=i 

and  let  Zi,  1  <  i  <  n,  denote  the  closed  disc  in  the  complex  plane  C,  with  center 
Xu  and  radius  ri(X),i.  e., 

Z{  =  {z  G  C  :  \z  -  xa\  <  rt(X)}  . 
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Any  eigenvalue  A  of  X  belongs  to  at  least  one  of  the  discs  Z{,  1  <  i  <  n.  Moreover  if 
m  of  the  discs  form  a  connected  set  S,  disjoint  from  the  n—m  remaining  ones,  then 
S  contains  exactly  m  of  the  eigenvalues  of  X,  counted  according  to  their  multiplicity 
as  roots  of  the  characteristic  polynomial  of  X.  The  numbers  r^X),  1  <  *  <  n,  are 
called  the  Gershgorin  radii  of  the  matrix  X. 

Proof  :  See  Atkinson  [7,  p.  500]. 


A 
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CHAPTER  III 


TWO  NODE  SYSTEM  WITH  PHASE  TYPE  SERVERS 

III.l.  Introduction  : 

This  chapter  is  devoted  to  the  analysis  of  a  two  node  system  with  PH-type 
servers  in  both  nodes.  Under  the  discrete-time  formulation  discussed  in  Sections  2 
and  3,  neccesary  and  sufficient  conditions  for  the  irreducibility  of  the  underlying 
Markov  chain  are  given  and  its  ergodic  and  transient  states  are  identified.  Explicit 
analytical  expressions  for  the  invariant  probabilities  of  the  system  are  shown  to  have 
a  matrix  geometric  form  and  closed  form  expressions  are  obtained. 

In  Section  4,  the  effect  of  reversing  the  order  of  the  servers  is  studied.  The 
results  for  the  discrete-time  formulation  are  illustrated  in  Section  5  through  nu¬ 
merical  examples,  for  some  specific  PH-type  service  distributions.  In  Section  6,  a 
continuous-time  formulation  of  the  same  model  is  discussed;  the  underlying  Markov 
chain  is  shown  to  always  be  irreducible,  and  closed  form  expressions  for  the  invariant 
probabilities  are  obtained  in  matrix  geometric  form. 
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III. 2.  The  discrete-time  model  : 

The  model  to  be  discussed  consists  of  two  nodes  separated  by  a  finite  inter¬ 
mediate  buffer  of  capacity  K,  i.  e.,  there  are  exactly  K  positions  in  the  buffer, 
inclusive  of  the  one  taken  by  the  job  in  service  at  the  second  node  server.  The 
service  times  at  both  nodes  have  PH-type  distributions  with  irreducible  represen¬ 
tations  (a,  A)  and  (fi,B),  respectively.  The  row  vectors  a  and  /?  and  the  matrices 
A  and  B  have  dimensions  lx/,  1  x  m,  l  x  /  and  m  x  m,  respectively,  and  the 
corresponding  l  x  1  and  m  x  1  column  vectors  of  absorption  probabilities  for  the 
first  and  the  second  node  server  are  denoted  by  a  and  6,  respectively.  There  is  an 
infinite  supply  of  jobs  available  in  front  of  the  first  node  server  and  the  second  node 
server  never  gets  blocked.  Immediate  blocking  is  assumed  in  that  blocking  of  the 
first  node  server  occurs  as  soon  as  the  intermediate  buffer  becomes  full.  The  first 
node  server  resumes  service  as  soon  as  there  is  a  space  available  in  the  buffer,  i.  e., 
whenever  a  service  completion  takes  place  at  the  second  node  server. 

A  natural  state  space  E  for  this  system  is  the  one  that  contains 
r  [K  —  1  )Zm  +  l  +  m  states  with 

'  (*,  0)  ,  1  <  *  <  l  ,  k  =  0, 

E  =  <  ( i,k,j )  ,  1  <  t  <  /,  0  <  k  <  K  and  1  <  j  <  m, 

,  (K,j)  ,  1  <  j  <  m  ,  k  -  K, 

where  k  indicates  the  buffer  size,  while  i  and  j  represent  the  service  phase  in  the 
first  and  the  second  node  server,  respectively.  The  phase  of  the  second  node  server 
is  not  defined  when  it  has  no  jobs  to  process  and  the  phase  of  the  first  server  is  not 
defined  when  the  buffer  is  full  since  blocked. 

The  invariant  probability  vector  of  these  states  is  denoted  by  the 
1  X  r  row  vector  7r.  This  vector  is  partioned  into  K  +  1  blocks  of  components, 
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say  7T  =  (flo,  7Ti, . . . ,  ttk),  with  7To,  tt/c,  0  <  k  <  K,  and  ttk  being  row  vectors  of 
dimension  lx/,  1  X  l  m  and  1  x  m,  respectively. 

By  lexicographically  ordering  the  states,  i.e.,  (1,0), ...» (/,0),  (1, 1, 1),  (2, 1, 1), 
...,(/,  1,  l),  (1, 1, 2), .. .,  the  one-step  state  transition  matrix  T  of  the  underlying 
Markov  chain  can  be  obtained  in  block  tridiagonal  form.  If  Tkllk2  denotes  the 
(fci)&2)-th  block  of  the  matrix  T,  0  <  ki,k2  <  K ,  then  the  reader  will  easily  check 
that 


Tk,k-i  =  b(3  <g>  A  1  <  k  <  K, 

Tk,k  =  B®A-\-b(3®aa  1  <  k  <  K, 

Tk,k+ 1  —  B  ®  a  a  1  <  k  <  K  —  1, 

where  each  block  isanlmxlm  matrix.  The  following  interpretation  can  be  given 
for  the  above  expressions:  For  the  equation  Tk,k- 1  =  b/3  ®  A,  the  buffer  size  will 
decrease  by  one  when  a  service  completion  take  place  in  the  second  node  server, 
according  to  the  absorption  vector  b,  and  the  new  phase  of  service  is  initialized 
according  to  the  initialization  vector  a  (if  there  is  a  job  availible  in  the  buffer), 
while  no  service  completion  occur  in  the  first  node  server  and  the  phase  of  service 
change  according  to  the  transition  matrix  A.  A  parallel  reasonning  can  also  be 
given  for  the  term  Tk,k+ 1*  On  the  other  hand,  at  the  end  of  the  time  epoch  the 
buffer  size  may  remain  unchanged  for  two  reasons:  i)  A  service  completion  may 
occur  at  both  servers,  b/3  <g>  aoc,  or  ii)  no  service  completion  occur  in  both  servers, 
B  <g>  A,  whence  the  interpretation  for  the  term  Tk,k-  For  the  boundary  states,  the 
entries  are  given  in  block  form  by 


Too  —  A 
Tio  =  b  ®  A 
Toi  =  /3  <8>  a  a 
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/  x  /  matrix, 
ml  x  l  matrix, 
l  x  ml  matrix, 


Tk-i,k  =  B  ®  a  ml  X  m  matrix, 

Tk,k- i  —  bp  ®  a  mx  ml  matrix, 

Tk,k  —  B  m  x  m  matrix. 

The  resulting  transition  matrix  then  takes  the  form 


(  A 

P  ®  aa 

\ 

b  ®  A 

B  ®  A+ 

B  ®  a  a 

b  P  ®  aa 

bp  ®  A 

B  ®A+ 

B  ®  aa 

bp  ®  aa 

, 

• 

b/3  ®  A 

B  ®A  + 

B  ®  a 

bp  ®  aa 

V 

b  P  ®  ct 

b  ; 

(3.2.1) 
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III. 3.  Analysis  of  the  discrete-time  model  : 

In  this  section,  necessary  and  sufficient  conditions  are  obtained  for  the  irre- 
ducibility  of  the  Markov  chain  with  one-step  transition  matrix  T  given  by  (3.2.1)  and 
explicit  solutions  for  the  invariant  probability  vector  are  obtained.  For  notational 
convenience,  when  the  intermediate  buffer  capacity  is  K,  the  one-step  transition 
matrix  (3.2.1)  is  denoted  by  Tk- 

The  case  K  =  1  is  discussed  first  since  the  results  for  the  general  discussion  do 
not  cover  this  case.  The  results  are  summarized  in  the  following  theorem. 
Theorem  3.3.1.  :  For  the  model  described  above  with  K  =  1,  t.  e.,  there  is  no 
intermediate  buffer,  the  underlying  Markov  chain  is  always  irreducible  and  the 
invariant  probability  vector  is  given  explicitly  by 

7T0  =  ca(Ii-A)~1,  7Ti  =  c(3  [Im  -  B)~l  ,  (3.3.1a) 

where 

c=  (a(Ii- A)~lei  + B)~1emy1  .  (3.3.16) 

Proof  :  Let  Eo  and  E\  be  subsets  of  the  state  set  E  given  by 

Ed  =  {%  £  E  :  x  =  (i,  0),  1  <  i  <  1} 

Ei  =  (x  e  E  :  x  =  (l,i),  1  <  j  <  m} 

Since  no  intermediate  buffer  space  is  available  other  than  the  one  taken  by  the  job 
in  service  at  the  second  node  and  immediate  blocking  is  assumed,  the  servers  cannot 
be  active  simultaneously  and  the  decomposition  E  =  Eo  U  E\  thus  holds.  Note  that 
the  one-step  transition  matrix  Ti  takes  the  form 

A  a  (3 
b  a  B 
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Since  the  PH-representation  (a,  A)  is  irreducible,  by  viewing  the  transitions 
from  the  states  in  the  set  Eq  to  the  states  in  the  set  E\  as  visits  to  the  instantaneous 
phase  l  +  1  of  the  first  server,  it  readily  follows  that  the  states  in  Eq  belong  to  the 
same  irreducible  class  of  E.  By  a  similar  argument,  the  states  in  E\  are  also  in 
an  irreducible  class.  The  irreducibility  of  the  Markov  chain  thus  follows  since  these 
two  irreducible  classes  of  E  communicate. 

The  equation  n  T\  —  tt  can  be  rewritten  as 

7T0  A  +  7Ti  ( b  a)  =  7 r0  (3.3.2a) 

7T0  (a/3)  +  7Ti  B  =  tti  .  (3.3.26) 

Solving  7To  from  (3.3.2a)  and  using  (3.3.2b)  with  the  relation  Bem  +  6  =  em  gives 

tt0  =  it o  a  cx.  (I i  A)  ~~ 1  .  (3.3.3) 

or  eqivalently, 

7T0  =  ca  (Ii  -  A)~x  ,  (3.3.4) 

with  the  identifation  c  —  7Tq  a.  Substitution  of  (3.3.4)  into  (3.3.2b)  readily  leads  to 

m  =  7T0  (a/3)  (Im  -  B)~l  =  c(3  (Im  -  5)-1  .  (3.3.5) 


Use  of  the  normalization  condition  ttq  ej  +  7Ti  em  =  1  gives  the  desired  result. 


A 

Next,  the  transitions  among  the  states  of  the  matrix  T%  are  discussed  in  detail 
since  they  will  be  used  to  characterize  the  irreducibility  of  the  matrices  Tk,  K  >  2. 

Let  E  denote  the  set  of  states  for  the  Markov  chain  with  one-step  transition 
matrix 


T2  = 


A 

b  ®  A 

0  mxi 


(3  ®  aa 

B  ®  A  +  b(3  ®  aa. 
b/3  ®  a 


0  lXm 

B  <g)  a 

B 
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If  the  sets  E&,  0  <  k  <  2,  are  defined  by 

Eq  {c  £  £  :  e  =  (i,  0),  1  2  <  /}, 

-Ei  :=  {e  e  E  :  e  =  (2,1,  j),  1  <  i  <  l,  1  <  j  <  m}, 

E2  :=  {e  e  E  :  e  -  (2,y),  1  <  j  <  m}  , 

then  Eo,Ei  and  E2  form  a  partition  of  the  set  E  and  the  transitions  among  the 

states  within  these  sets  are  induced  by  the  directed  graphs  G(A ),  G(B  <g»  A  +  b/3  <8> 
aa)  and  G(B ),  respectively.  In  general,  these  directed  graphs  may  induce  several 
irreducible  classes,  say  J£,  1  <  r  <  R k,  0  <  k  <  2,  and  a  set  of  transient  states,  say 
Tk ,  0  <  k  <  2,  respectively.  In  order  to  more  completely  understand  the  transition 
mechanism  of  the  underlying  Markov  chain  among  the  states  in  E ,  and  characterize 
the  ergodic  and  transient  states,  the  following  sets  are  introduced: 

El  :=  {(2,  l,i)  €  Ei  :cnPs>  0}, 
n-T^Ei , 

E[  :=  /[  U  {e  £  Tj*  :  /[  is  reachable  from  e }  1  <  r  <  J?i, 

U  {e  €E  Ti  :  e  is  reachable  from  2Y  and  /[  is  reachable  from  e}  , 

Hi  :=  {r,  1  <  r  <  Rx  :  E\  D  E\  +  0} 

E£  :=  Irk  U  {(^,2)  E  Tk  :  {k,i)  is  reachable  from  Useni  E{ 

and  Ifr  is  reachable  from  (£,2)}  k  =  0,2,  1  <  r  <  Rk, 

Hfc  :=  {r,  1  <  r  <  Rk  :  El  is  reachable  from  the  set  Uaenx  E ^},  k  —  0,2, 

Tfc  :=  {l,2,...,iEjfc}\nfc  ,  0  <  k  <  2, 

(3.3.6) 

where  1  <  2  <  /  and  1  <  j  <  m.  Note  that  each  set  E£,  0  <  k  <  2,  1  <  r  <  Efc, 
has  two  components,  one  in  the  rth  irreducible  class  1 1  of  Ek  and  the  one  formed 
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by  states  which  are  transient  for  the  directed  graph  governing  the  law  of  motion 
within  the  set  Ek,  but  for  which  there  exists  a  path  that  connects  the  irreducible 
classes  in  the  sets  Ek>,  0  <  k'  ±  k  <  2,  to  the  irreducible  class  /£.  The  index  sets 
f Ik,  0  <  k  <  2,  identify  the  sets  Erk,  0  <  k  <2,  1  <  r  <  Rk,  that  communicate  with 
each  other  through  a  service  completion  process.  The  transitions  from  any  state  in 
Eq  U  E2  to  any  state  in  E\  is  due  to  a  service  completion  either  in  the  first  or  the 
second  server.  In  either  case,  the  phases  in  both  PH-distributions  are  reinitialized. 
Therefore,  the  Markov  chain  can  enter  the  set  E 1  only  from  the  states  in  the  set 
E 1.  Furthermore,  every  state  in  the  set  E{  is  reachable  from  every  state  in  the  set 
E0  U  E2.  Therefore,  in  view  of  these  definitions  the  following  property  (P)  holds, 
where 


(P):  The  sets  E[,  r  G  fli,  are  reachable  from  every  set  Eq  and  E^' ,  1  <  r  <  Ro 
and  1  <  r'  <  R2,  and  the  sets  E[,  r  G  Ti  and  the  set  Ti  \  E{  are  not  reachable 
from  any  state  in  Eq  U  £’2- 

If  fi0  U  fi2  =  0  then,  once  the  process  reaches  a  state  in  the  set  Ur6n!  >  the 
service  completions  in  the  PH-type  servers  occur  at  the  same  time  so  that  there 
will  always  be  one  job  in  the  buffer.  Since  all  the  sets  E[,  r  G  fii,  are  reachable 
through  a  service  completion  in  both  servers,  the  states  in  the  sets  E[,  r  G  0 1 
communicate,  whence  the  set  Urgni  f°rms  an  irreducible  class  for  the  matrix  T2 
and  all  the  other  states  will  be  transient.  On  the  other  hand,  if  fio  U  O2  7^  0>  then 
from  the  above  argument  none  of  the  sets  E[,  r  6  fii  are  absorbing,  and  owing  to 
property  (P),  the  set  :=  U/Uo  Uren*  f°rm  an  irreducible  class  for  T2.  The 
sets  E[,  r  G  Ti,  can  not  be  absorbing  sets  since  this  would  mean  that  the  service 
completions  occur  at  the  same  time  in  both  servers,  and  this  would  contradict  the 
fact  that  they  are  not  reachable  from  Eq  U  Ei-  Therefore,  the  states  which  are  not 
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in  the  set  are  the  transient  states  of  Ti- 

The  above  discussion  can  be  summarized  in  the  following  theorem. 

Theorem  3.3.2.  :  The  Markov  chain  with  one-step  probability  transition  matrix 
Ti  is  either  irreducible  or  it  has  a  single  irreducible  class  and  the  remaining  states 
are  transient.  Furthermore,  the  irreducible  class  of  the  chain,  denoted  by  T® ,  is 
given  by 

rMJU*!'  (3-3.7) 

k= 0 

The  following  corollary  follows  immediately  from  Theorems  3.3.2  and  2.3.13. 

Corollary  3.3.3.  :  For  the  model  described  above,  when  K  =  2,  the  invariant 
probability  distribution  vector  is  always  unique. 

The  analytical  expression  for  the  invariant  distribution  when  K  ~  2  is  included 
in  the  statement  of  Theorem  3.3.7. 

The  directed  graph,  G(T2),  of  the  matrix  T 2  can  be  used  to  obtain  information 
about  the  classification  of  the  states  of  the  Markov  chain  induced  by  the  matrix 

Tk,  K  2.  In  order  to  avoid  confusion  in  the  discussion,  the  state  space  for  the 

model  with  intermediate  buffer  capacity  K  >  2  is  denoted  by  E.  As  in  the  case 
K  =  2  the  state  space  E  is  partitioned  into  sets  Ek,  1  <  k  <  K,  where  Ek  are 
defined  by 

Eo  :=  {e  £  E  :  e  -  (t,0),  1  <  *  <  /}  , 

Ek  :=  {e  €  E  :  e  -  {i,k,j),  1  <  i  <  l,  1  <  j  <  m}  ,  (3.3.8a) 

Ek  :=  (e  €  E  :  c  =  {K,j),  1  <  j  <  m}  , 
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and  the  subsets  E k,  1  <  r  <  Rk  of  Ek  are  defined  as 

pr  . _  rpr 

Hjq  .—  £iq  , 

Erk  :=  {{i,k,j)  :  (i,  1  ,j)  G  E[,  1  <  *  <  m,  1  <  j  <  /}  ,  0  <  k  <  K  (3.8.86) 
ErK  :=  {(. KJ )  :  (2 ,j)  G  Er2 ,  1  <  j  <  1}  . 

Comparison  of  the  matrices  Tk  and  T 2  quickly  reveals  that  the  equailities 

G(£0)  =  G{E0) 

G{Ei)  =  G{Ek)  ,  0  <k<K  (3.3.9) 

G{E2)  =  G{Ek) 

holds,  where  the  notation  =  indicates  that  the  associated  directed  graphs  have  same 
topological  structure. 

By  using  the  notation  developed  for  T2  the  following  cases  are  studied: 

(i)  O0  =  0  and  ^2  =  0;  As  discussed  for  K  =  2,  this  means  that  when  both  servers 

are  operational  the  service  completions  occur  at  the  same  time.  From  the  discussion 
given  for  K  =  2  and  relations  (3.3.9)  each  set  Ek,  0  <  k  <  K,  l<r<  Rk, 

form  an  ergodic  class  for  Tk-  Note  that  these  are  not  the  only  ergodic  classes  of 
Tk  and  there  may  be  other  ergodic  classes  formed  by  the  communication  of  the 
transient  states  of  Ek  that  are  not  in  any  of  the  sets  Ek,  1  <  k  <  K,  1  <  r  <  Rk. 

(ii)  fio  7^  0  and  =  0;  In  this  case,  again  owing  to  (3.3.6)  and  (3.3.9)  the  sets  Ek  are 

A/  /V 

not  reachable  from  the  sets  Ek- 1,  while  the  sets  Ek-i  are  reachable  from  the  sets  Ek, 

for  1  <  k  <  K.  Therefore  all  the  states  in  the  set  Ufc=2  ^  U  [lJjfe=o  Urerfc  & k 

are  transient  states  for  Tk  and  the  states  in  the  set  Ul=o  Urenfc  I°rm  a  single 
irreducible  class,  where  Tk  and  O*,  0  <  k  <  2  are  as  defined  in  (3.3.6). 
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(iii)  Ho 
the  set 


=  0  and  f&2  7^  0;  A  similar  argument  as  in  case  (ii)  shows  that  the  states  in 
[jk=Q  Ek  U  (ur€~i  Ek-i)  U  (ur€r2  Ek) ]  are  transient  states,  while 

the  states  in  the  set  ^Urenj  ErK_^j  (J  (uren2  Ek)  f°rm  a  single  ergodic  class. 

(iv)  fio  7^  0?  7^  0  and  Eq  and  Ek  are  reachable  from  every  state  in  the  set 

Ufji1  Ek',  A  sufficient  but  not  necessary  condition  for  this  to  happen  is  that  Eo 
and  Ei  are  reachable  from  every  E[  in  G^).  Let  the  set  X  be  defined  as 

X  :=  {e  E  E  :  e  is  reachable  from  the  set  Eq  U  Ek}  - 


Note  that  Eo  U  Ek  Q  X.  In  this  case,  every  state  in  X  communicates  with  each 
other,  possibly  through  the  states  in  the  set  Eo  U  Ek-  Therefore,  the  set  X  form 
an  ergodic  class  for  Tk  and  the  states  in  the  set  E  \  X  are  the  transient  states  as 
they  have  access  to  the  set  Eq  U  Ek  but  not  reachable  from  Eo  U  Ek- 
The  following  results  are  immediate  consequences  of  this  discussion. 

Lemma  3.3.4.  :  If  cases  (ii)-(iv)  above  holds,  then  the  matrices  Tk,  K  >  2,  have 
a  single  ergodic  class. 

Corollary  3.3.5  :  If  cases  (ii)-(iv)  above  holds,  then  the  invariant  probability 
distribution  vector  i r  for  the  Markov  chain  with  one-step  transition  matrix  Tk, 
K  >2,  is  unique. 

Lemma  3.3.6.  :  If  case  (i)  above  holds,  then  the  matrices  Tk,  K  >  2,  have  several 
ergodic  classes. 
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In  order  to  obtain  a  closed  form  expression  for  the  vector  7 r,  proceed  as  follows: 
The  equation 

7 r  Tk  =  7T  ,  7rer  -  1 

satisfied  by  the  invariant  vector  can  be  rewritten  as 

7T0  A  +  7Ti  (6  ®  A)  =  7To  (3.3.10a) 

7To  (/?  ®  a  a)  +  tti  (B  <g>  A  +  bfi  ®  a  a)  +  7T2  (b/3  ®  A)  =  7Ti  (3.3.106) 

7Tfc_i  (B  ®  a  oc)  +  -irk  (B  0  A  +  b  (3  ®  a  a)  +  7Tk+i  (b/3  ®  A)  —  -Kk  (3.3.10c) 

1  <  k  <  K  -  1 

itk-2  (B  0  a  a)  +  tvk-i  (B  0  A  +  b/3  ®  a  a)  +  ttr  (b/3  ®  a)  =  ttk_i  (3.3.10d) 

7Tk~i  (B  ®  a)  +  7Tic  B  =  kk  •  (3.3.10e) 

Postmultiplication  of  (3.3.10a)  by  e/,  of  (3.3.10b)-(3.3.10d)  by  (em  ®  e/)  and  of 
(3.3.10e)  by  em  leads,  after  simplifications,  to  the  relations 

7 Tfc  [6  ®  (e;  -  a)]  —  7Ta;_x  [(em  —  6)  <g>  a]  =  0  ,  1  <  k  <  K  ,  (3.3.11) 

whence  upon  postmultiplication  by  ((3  ®  a) , 

■Kk  \b (3  ®  (ei  —  a)  a]  = 'Kk-i  [  (em  —  6)  (3  ®  a  a]  ,  1  <  A;  <  JT  .  (3.3.12) 

Note  that  the  left  hand  side  of  equation  (3.3.11)  is  the  transition  probability  from 
the  set  Ek  to  the  set  Ek- 1  in  one  step  while  the  right  hand  side  of  (3.3.11)  is  the 
transition  probability  from  the  set  Ek- 1  to  the  set  Ek-  Now,  postmultiplication  of 
(3.3.10b)-(3.3.10d)  with  (em  (3  ®  I{)  and  use  of  (3.3.10b)-(3.3.10d)readily  yield 


7T 1  \B(em(3 

Im )  0  A  - (-  (Im 

Cm  P)  0  Il\ 

—  Omi 

(3.3.13a) 

TTfc  [ B  (cm  (3 

Im)  ®  A  d*  (Im 

Cm  fi)  ®  Il\ 

+7^-1  [B  (em(3  - 

Im)  0  n  0] 

=  0 ml  1  <  k  <  K  , 

(3.3.136) 

-  38  - 


whereas  postmultiplication  of  (3.3.10b)  and  (3.3.10c)  by  (Jm  ®  (e*  a  —  /*))  gives 


tt/c+1  [b/3  ®  A  (ei  a  —  It)]  + 

(3.3.14) 

Trie  [B  ®  A  ( et  a  —  It)  —  Im  ®  (em  a  —  //)]  =  0m;  ,  1  <  k  <  K  —  1  . 

Although  both  (3.3.13)  and  (3.3.14)  provide  a  relation  between  the  vectors  Kk  and 
TTk-i  for  1  <  k  <  K,  neither  of  these  relations  yields  a  recursive  solution  for  the 
vectors  7Ck,  1  <  k  <  K,  since  all  the  matrices  in  square  brackets  in  these  equations 
turn  out  to  be  singular.  Indeed,  (0,em  ®  e/)  is  eaily  seen  to  be  a  right  eigenpair  for 
both  matrices  upon  postmultipliying  them  by  em  ®  e/.  Now,  recall  the  definition 
(2.3.3)  of  the  matrices  M  and  N .  Equation  (3.3.13b)  gives  the  relation 

TCk  N  -  1 Xk  [  ( Im  P)  ®  II  (em  P  B)  ®  A] 

=  7 Tk  [em  P  ®  A  B  em  P  ®  A]  +  tt/s— i  \B  ( Im  em  P)  ®  a  ol] 

—  7Tk[bP  ®  A\  +  nk-i[B  (Im  -  emp)  ®  a  a] ,  l<k<K  , 


which  combines  to  (3.3.12)  to  yield 

■Kk  N  =  TCk  [bp  ®{A—  ( e\  —  a)  a)]  +  Kk-i [B  ®aa]  ,  1  <  k  <  K  . 

Similarly,  use  of  (3.3.13a)  and  (3.3.10a)  readily  gives 

7T i  N  —  7Ti  [bp  ®  A] 

=  TTo  [P  ®  (/;  -  A)]  . 


(3.3.15) 


(3.3.16) 


On  the  other  hand,  (3.3.14)  can  be  rewritten  in  the  form 


irk  M  =  7Tk  [B  ®  aa]+7Tk+ 1  [bp  ®  {A  —  (ei  —  a)  a)  ]  ,  l<k<K—l  .  (3.3.17) 
Upon  combining  (3.3.15)  and  (3.3.17),  the  reader  will  check  that 


7 rk  N  =  7Tfc_i  M  ,  1  <  k  <  K  .  (3.3.18) 
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The  system,  of  equations  (3.3.18)  can  be  solved  recursively  if  either  the  matrix  N  or 
the  matrix  M  is  invertible.  The  explicit  solution  is  presented  when  the  matrix  N 
is  invertible.  Necessary  and  sufficient  conditions  for  the  invertibility  of  N  are  given 
in  Lemma  2.3.17  and  Corollary  2.3.18,  respectively.  From  (3.3.16),  (3.3. lOe)  and 
(3.3.18)  it  follows  that 

7Ti  =  7T0  (0  0  (I;  -  A)  )  N~1 

TTfc  =  Kk-1  MN~l  1  <  k  <  K,  (3.3.19) 

TTif  =  kk-i  ( B  <g>  a)  (Jm  -  B)_1  . 

Postmultiplication  of  (3.3.10b)-(3.3.10d)  by  (em<g>Ij)  and  of  (3.3.10e)  by  em®a 
gives 

7r0  aa  +  7Ti  (Bem  <g>  t!  +  6  0  aa)  +  7t2(6  ®  A)  =  7Ti  (em  ®  /j)  (3.3.20a) 

Tffc-x  (5em  ®  aa)  +  TVk  (B  em  <g>  A  +  6  ®  a  a)  (3.3.206) 

TTfc+i  (6  <8>  A)  =  Ti-fc  (em  (g>  Ii)  ,  1  <  A:  <  K  -  1 
7TK-2  {B  em  ®  a  a)  +  t^k-i  {B  em  ®  A  +  b  aa)  (3.3.20c) 

+nK  (6  <g>  a)  =  7rx-i  (em  <g>  I/) 

TTK-i  (Bem®aa)+  tt^  ( B  em  ®  a)  -  ttk  (em  <g>  I/)  (3.3.20d) 

Summation  of  (3.3.20b)  over  fc,  1  <  k  <  K  -  1  and  use  of  (3.3.20a),  (3.3.20c), 
(3.3.20d)  and  (3.3.10a)  lead  after  some  simplification  to  the  relation 

K~  1  /  if-1  \ 

7T0  +  E  TTfc  (em  <8>  IQ  =  I  7T0  +  7T*(em®//)j  (A  +  aa)  .  (3.3.21) 

i=i  V  i=i  / 

Equations  (3.3.19)  and  (3.3.21)  combine  to  give  the  main  result,  which  is  sum¬ 
marized  in  the  following  theorem. 
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Theorem  3.3.7.  :  Let  the  lx  l  row  vector  x  be  the  unique  solution  to  the  equation 

x(A-\-aa)  =  x  ,  xei  =  1  .  (3.3.22) 

If  the  matrix  N  is  invertible,  then  any  invariant  probabilty  vector 
tx  —  (flo ,  ...,7Tjc)  has  the  following  matrix  geometric  form 

Kk  =  tto  S  R *_1  1  <  k  <  K  (3.3.23a) 

ixK  =  tto  S  Rk~2  U  ,  (3.3.236) 

where  the  vector  no  satisfies  the  equation 

tto  Z  =  x  .  (3.3.24) 

The  matrices  R,S,U  and  Z  are  defined  through  the  equations 


M  =  Im  ®  (Ii  —  ei  a)  +  B  <g>  (ei  a  —  A ) 
N  =  (Jm  -  em  /?)  <g>  Jj  +  (em  P  -  B)  <g>  A 
R  =  M  N~x 
S  =  l/3®{It-A)}  N-1 
U  =  {B®a)  {Im-B)-1 

w  =  h+  [eJL-!1  S  i2i_1]  (em  0  /,) 

Z  =  py  +  si/ff"2  U  emx 


ml  X  ml  matrix, 
ml  x  ml  matrix, 
ml  xml  matrix, 
l  x  ml  matrix, 
ml  x  m  matrix, 

/  x  /  matrix, 
l  x  l  matrix. 


Proof  :  The  irreducibility  of  the  matrix  [A  +  aa)  implies  that  the  system  (3.3.22) 
has  a  unique  solution  x.  Equation  (3.3.23)  follows  from  (3.3.19)  and  combines  with 
(3.3.21)  to  yield 

7To  W  [A  +  aa)  =  7Tq  W  , 


whence,  7To  W  —  cx  for  some  constant  c.  The  normalization  condition  tt  er  =  1  and 
(3.3.23)  lead  to  c  =  1  —  7Tk  em.  Therefore, 

txqW  —  (1  —  7TK"em)x  =  x  —  7t0SRk~2  Uem  x  , 
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and  the  relation 

7T0  [W  +  SRk~2  Uem  s]  =  7r0  Z  —  x 
follows  upon  grouping  terms  appropriately.  This  completes  the  proof. 


A 
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III.4  The  effect  of  reversing  the  order  of  the  servers  : 

In  this  section,  the  model  of  Section  3.2  is  studied  when  the  order  of  the  servers 
is  reversed,  i.  e.,  the  first  and  the  second  node  servers  have  PH-representations 
{/3,  B)  and  (a,  A),  respectively.  The  states  of  the  system  are  now 

'  (°J)  ,  1  <j<m,  k  =  0, 

<  ( i ,  k,j),  l<i<l,0<k<  K,  and  1  <  j  <  m, 

.  (*,  K)  ,  1  <»</,  k  =  K. 

Note  that  now  the  first  index  denote  the  phase  of  the  second  node  server.  The 
invariant  probability  vector  is  denoted  by  Sr  and  is  partitioned  into  K  +  1  block 
components  S f*,  0  <  A;  <  K,  as  in  Section  2.  By  lexicographically  ordering  the 
states,  the  one-step  state  transition  matrix  T  of  the  underlying  Markov  chain  can 
be  obtained  in  the  block  tridiagonal  form 


l  B 

B  ®  a 


T  = 


b  (3  ®  a 

B  ®  A+  b(3  ®  A 
b(3  ®  a  a 

B  ®  act  B  ®  A+ 
b(3  ®  act 


b  (3  ®  A 


\ 


(3.4.1) 


V 


B®aa  B®A+  b®A 
b fi  ®  act 

(3  ®  a  a  A  J 


while  the  equation  Sr  T  =  Sr  fot  the  invariant  probability  vector  Sr  can  be  rewritten 
as 
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7Tk  A  +  ttr-i  (6  ®  A)  =  7 tk  (3.4.2a) 
kk  {ft  <S>  cl  a)  +  7Tk-i  {B  0  A  +  bft  ®aa)  +  %k- 2  {b  ft  0  A)  =  kr-i  (3.4.26) 
TT/t-fi  (B  ®  a  O')  +  7Tfc  (B  ®  A  +  6/3  <g>  aa)  +  7r*;_i  (6/?  ®  A)  =  7rfc  (3.4.2c) 

1  <  k  <  K  -  1 

7T2  (B  0  a  a)  +  7Ti  (B  0  A  +  b  0  0  a  a)  +  7ro  (b  ft  0  a)  =  Sri  (3. 4. 2d) 

7Ti  (B  0  a)  +  7To  B  =  7r0  (3.4.2e) 

A  direct  comparision  of  (3.4.2)  and  (3.3.8)  quickly  reveals  that 

7T/c  =  TTif-fc  ,  o  <  k  <  K  .  (3.4.3) 

Denoting  the  service  phase  in  the  first  and  the  second  node  servers,  and  the  buffer 
size  at  steady  state  by  the  random  variables  PH  1,  PH 2  and  C,  respectively,  (3.4.3) 
now  reads  as 

P{PH  1  =  i,  C  =  0}  =  Pr{PB2  =  t,  C  =  K}  , 

P{PHl  =  i,C  =  k,PH2=j}  =  Pr{PHl=j\C  =  K-k,PH2  =  i},  0  <  k  <  K, 
P{PH2  =j,  C  =  K}  =  Pr{PHl  =j,C  =  0}  , 

(3.4.4) 

for  1  <  i  <  l,  1  <  j  <  ra,  where  Pr  corresponds  to  the  probability  measure  when 
the  order  of  the  servers  is  reversed.  In  particular  the  marginal  probabilities  satisfy 
the  relations 

P{C  =  k}  =  Pr{C  =  K~k}  ,  0  <k<K, 

P{PH1  =  i}  =  Pr{PB2  =  *}  ,  1  <  *  <  l  , 

P{PH2=j}  =  Pr{PHl=j},  1  <  j  <  m  . 
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A  probabilistic  interpretation  for  this  kind  of  reversibility  is  provided  in  Mela¬ 
med  [49]  by  embedding  both  the  original  and  the  reversed  system  in  the  same 
probability  space  and  by  viewing  the  vacant  buffer  locations  (holes)  of  the  original 
system  as  “occupied”  by  fictitious  dual  jobs.  As  regular  jobs  march  through  the 
buffer  in  one  direction,  the  holes  march  in  the  opposite  direction  and  they  both 
receive  identical  service  times. 
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III. 5.  Numerical  examples  : 


In  this  section,  Theorem  3.3.7  is  illustrated  with  specific  PH-type  distributions. 
Typical  examples  of  PH-type  distributions,  such  as  Negative  Binomial  and  Hyper¬ 
geometric  distributions,  are  used.  First,  three  different  examples  are  considered  by 
using  PH-type  distributions  with  the  following  numerical  values: 

1.  Negative  Binomial  of  order  3  ( NB3 )  with  =  0.75,  p,2  —  0.5  and  p, 3  =  0.6, 

2.  Hypergeometric  of  order  3  (HG 3)  with  a  =  (0.5, 0.3, 0.2)  and 

Q  =diag(0.75, 0.85, 0.8), 

3.  Hypergeometric  of  order  4  (HG4)  with  a  =  (0.3, 0.1, 0.2, 0.4)  and 

Q  =diag(0.4, 0.5, 0.2, 0.5) . 

The  expected  service  time  ES(-)  can  be  found  by  using  P'(l)  =  o:(Jm  ~ 
Q)-1  em.  The  numerical  values  given  above  lead  to  E  S(NB 3)  =5,  E  S[HG 3)  =5 
and  ES{HG4 )  =  1.75. 

The  following  three  examples  are  considered. 

1st  Node  2nd  Node 

(i)  NB3  hg3 

(ii)  HGZ  HBZ 

(iii)  HG4  HGz 

In  Table  (3.5.1),  the  values  of  pk  =  the  invariant  probability  of  having 

k  customers  in  the  buffer,  are  displayed  for  buffer  size  K=6.  The  calculations  are 
carried  out  in  double  precision  complex  arithmetic  up  to  15  digits  after  the  decimal 
point.  Only  the  first  four  digits  after  the  decimal  point  are  displayed  in  Table 
(3.5.1).  The  last  row  checks  the  normalizing  condition  and  it  is  accurate  up  to  10-15. 
Many  of  the  matrices  defined  in  Theorem  3.3.7  are  of  the  form  X  —  B  A~l  and 
are  computed  as  the  solution  of  equation  X  A  =  B,  by  using  Gaussian  Elimination, 
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instead  of  directly  computing  the  inverses. 


K  =  6 

buffer  size 

nb3  -  hg3 

HGZ  -  NB3 

HG4  -  hg3 

0 

0.0875 

0.0875 

1.0836X  10-4 

1 

0.1773 

0.1447 

5.9041xl0~4 

2 

0.1705 

0.1645 

0.0027 

3 

0.1680 

0.1680 

0.0120 

4 

0.1645 

0.1705 

0.0560 

5 

0.1447 

0.1773 

0.2786 

6 

0.0875 

0.0875 

0.6500 

sum 

1.0 

1.0 

1.0 

Table  3.5.1. 


Cases  (i)  and  (ii)  show  the  effect  of  reversing  the  order  of  the  servers  and  the 
results  confirm  the  conclusion  of  Section  4.  In  the  third  case,  the  first  node  server 
is  being  faster  than  the  second  node  server,  the  buffer  is  usually  full  and  the  first 
node  server  is  mostly  in  blocked  position. 

As  a  second  example,  a  system  that  contains  unreliable  servers  with  constant 
production  times  of  one  time  slot  is  considered.  The  up  and  down  times  of  the 
servers  are  assumed  geometric  with  parameters  p  and  g,  respectively,  and  the  servers 
are  assumed  to  fail  only  when  processing  a  job.  A  two  node  blocking  system  that 
involves  such  unreliable  servers  has  been  studied  by  many  authors  (class  ii.a).  The 
service  distribution  of  such  an  unreliable  server  has  a  PH-type  distribution  which 
can  be  represented  by  the  pair  (a,Q),  where 

<*  =  (i,o)  aild  <3=(°  • 
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The  following  numerical  values  are  used  for  the  servers, 
pi  =  0.95  pi  =  0.6 

qi  —  0.8  qi  —  0.2 

For  these  values,  the  expected  service  times  for  server  one  and  server  two  are  1.12 
and  5,  respectively.  The  vectors  irk  and  the  probability  of  finding  k  customers  at 
steady  state,  P{C  =  k},  0  <  k  <  6  ,  are  shown  in  Table  3.5.2.  As  expected  the 

buffer  is  mostly  full  since  the  first  server  is  faster  than  the  second  one. 


K  =  6 

buffer  size  ( k ) 

W k 

P{C  =  A;} 

0 

10~4  x  (0.5356,  0.2965) 

0.8321  x  10-4 

1 

10~3  x  (0.4528,0.0622,0.0315,0.0182) 

0.5647  x  10~3 

2 

10~3  X  (0.8628,0.2936,0.3311,0.0643) 

0.0016 

3 

(0.0066, 0.0007, 0.0010, 0.0003) 

0.0086 

4 

(0.0011, 0.0057, 0.0056, 0.0008) 

0.0133 

5 

(0.1866, 0.0003, 0.0079, 0.0048) 

0.1996 

6 

(0.1306,0.6457) 

0.7763 

sum 

=  1.0  exact  up  to  15  digits. 

Table  3.5.2. 


A  word  of  caution:  After  computing  the  matrices  M  and  N  to  form  R ,  the  use 
of  the  equations  tx-i  =  7Tx  R  and  (3.3.10a)  in  (3.3.10b)  gives 


7T  i  =  LtT  i 


(3.5.1) 
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with  the  matrix  L  being  given  by 

L  =  (b  0  A)  (Ii  —  A)-1  (j3®aa)+B®A  +  bp®aa  +  R(b(3®A)  (3.5.2) 

To  get  the  invariant  probability  vector  7 r,  a  direct  approach  might  be  to  solve  (3.5.1) 
for  tti,  as  suggested  in  Neuts  [58,  p.  126]  for  the  continuous-time  version  of  the 
problem.  The  difficulty  with  such  a  procedure  is  that  the  solution  7Ti  to  equation 
(3.5.1)  may  not  be  unique.  For  instance,  in  the  last  example  the  eigenvalues  of  L 
are  1,  1,  0.1294  and  -0.0494,  and  the  vectors  x\  =  (0.9995,-0.0220,0.0071,0.0220) 
and  x%  —  (1.3539, 1.2397,0.5084,0.1745)  are  both  eigenvectors  of  L  with  eigenvalue 
A  =  1.  Hence,  the  eigenvectors  of  L  that  corresponds  to  A  =  1  lie  in  the  subspace 
spanned  by  x\  and  x 2.  Therefore,  the  eigenvalue  problem  (3.5.1)  does  not  yield 
to  a  unique  solution  7Ti,  and  (3.3.24)  needs  to  be  solved  for  7To  in  order  to  get  the 
invariant  probability  vector  7T. 
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III.6.  The  continuous-time  formulation  : 

In  this  section,  a  complete  solution  to  the  same  problem  is  presented  in 
continuous-time  to  show  that  the  two  formulations  do  not  subsume  each  other.  The 
continuous-time  formulation  has  two  major  advantages:  The  underlying  continuous¬ 
time  Markov  chain  is  always  irreducible,  and  the  computations  to  obtain  the  explicit 
solution  are  simpler. 

The  service  distributions  of  the  first  and  the  second  node  servers  again  admit 
representations  (a,  A)  and  (/ 3,B ),  respectively,  which  are  assumed  irreducible.  The 
row  vectors  a  and  (3  and  the  infinitesimal  generator  matrices  A  and  B  have  dimen¬ 
sions  lx/,  lxm,  l  X  l  and  m  X  m,  respectively.  The  corresponding  l  X  1  and 
m  x  1  column  vectors  of  absorption  rates  for  the  first  and  the  second  node  server 
are  denoted  by  a  and  6,  respectively. 

The  state-space  of  the  continuous-time  Markov  chain  is  defined  as  in  Section 
2,  while  the  corresponding  generator  matrix  T  of  the  underlying  Markov  process 
can  be  obtained  by  ordering  the  states  in  the  lexicographical  order  as  before.  The 
resulting  infinitesimal  generator  matrix  then  takes  the  form 


(  A 

(3  ®  aa 

b®  Ii 

B  ®  Ii+ 

Im®  a  OL 

Im®  A 

b  (3  ®  Ii 

B  ®  Ii+ 

Im®  A 

A 


(3.6.1) 


V 


b (3  ®  Ii  B  ®  Ii+  Im  ®  o 

Im  ®  -A 

b{3  ®  a  B  J 


The  irreducibility  of  this  continuous-time  Markov  chain  is  first  established. 
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Theorem  3.6.1.  :  For  the  contiuous-time  version  of  the  model  described  in  Section 
2,  the  underlying  continuous-time  Markov  chain  is  always  irreducible. 

Proof  :  In  the  continuous-time  formulation,  two  events  cannot  occur  simultane¬ 
ously  (with  a  positive  probability)  unlike  for  the  discrete-time  case.  This  fact  to¬ 
gether  with  the  independence  and  irreducibility  of  the  service  representations  (a,  A) 
and  yields  the  following  access  relations: 


(i,0) 

(*\*»j) 

(KJ) 


{i',k  +  l,j)  0<k<K-l, 


(KJ) 


K~  1 


(3.6.2) 


(i,k  —  1  ,j')  1  <  k  <  K, 

(i,0)  k  =  1, 


for  every  1  <  i,  i'  <  l  and  1  <  j,j'  <  m. 

It  is  now  easy  to  see  that  starting  from  an  arbitrary  state  (i,k,j),  any  other 
arbitrary  state  (if,  k  +  n,j')  can  be  reached,  for  1  <  &,  k  +  n  <  K  —  1.  For  the  case 
when  n  >  0,  based  on  (3.6.2),  there  is  a  path  from  the  state  (i,  k,j)  to  (*',  k+n+1,  j), 
and  then  from  this  state  to  the  state  (i',k  +  n,j').  A  similar  argument  can  be  made 
when  n  <  0,  first  by  fixing  i  and  then  j.  Since  these  two  states  are  arbitrary  all  the 
states  of  the  Markov  chain  in  the  sets  Ek,  1  <  k  <  K  —  1,  communicate,  where  the 
sets  Ek,  0  <  k  <  K ,  are  defined  as  in  Section  3.  Similar  arguments  reveal  that  the 
states  in  the  sets  Eq  and  E\,  and  Ek- i  and  Ek,  respectively,  also  communicate. 
Therefore,  all  the  states  in  E  communicate  with  each  other  since  the  sets  Ek- 2 
and  Ek- i,  and  E\  and  E 2,  respectively,  are  reachable  from  each  other. 

A 

In  order  to  obtain  a  closed  form  solution  for  the  invariant  vector  7r,  the  equation 
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7T  T  =  Or  it  satisfies  can  be  rewritten  as 

7To  A  +  7Ti  (6  0  ii)  =  0 1  (3.6.3a) 

7To  (l3®aa)+  7T i  (J3  0  i/  +  im  0  -^)  +  ^  (6/3  0  ii)  =  Oim  (3.6.36) 

TVk-l  (im  0  a  O')  +  7Tjt  (-B  (g>  Ii  +  Im  0  -'4)  +  ^fc+l  iP P  ®  ii)  =  ®Im  (3.6. 3c) 

1  <  Jfc  <  JfiT-  1 

TTif-2  (im  ®«a)+  7TK-1  (-B  0  ii  +  im  0  A)  +  IT  K  (6/?  0  a)  =  0 im  (3.6.3 d) 

7Tjc—i  (im  0  a)  +  7rjf  B  =  Om  (3.6. 3e) 

Postmultiplication  of  (3.6.3a)  by  ej,  of  (3.6.3b)-(3.6.3d)  by  (em  0  e{]  and  of 


(3.6.3)  by  em,  after  simplifications,  gives 

TTfc  (6  0  ei)  —  Ttk-i  {em  0  a)  =  0  ,  1  <  k  <  K  ,  (3.6.4) 

while  postmultiplication  of  (3.6.4)  with  (/3  0  a)  yields 

i\k  (6/3  0  ez  a)  =  TVk—i  (em  /3  0  a  a)  ,  1  <  k  <  K  .  (3.6.5) 

Now,  postmultiplication  of  (3.6.3b)-(3.6.3d)  with  (em  0  ®  h)  and  use  of  (3.6.3b)- 
(3.6.3d)  imply 

7Ti  [( B  +  6/3)  0  ii  +  (im  -  em  /3)  0  A]  =  0Zm  (3.6.6a) 

7Tfc  [(B  +  6/3)  0  ii  +  (im  —  em  /?)  ®  -A] 

+7T&_1  [(im  -  em  /3)  0  a  a]  =  0/m  ,  l  <k  <K  .  (3.6.66) 

Postmultiplication  of  (3.6.3b)  and  (3.6.3c)  by  (im  0  (ei  a  —  i;))  yields 

7Tfc+i  [6/3  0  (ii  -  eia)}  g  ? 

+  TTfc  [5  0  (ii  —  ez  a)  +  im  ®  (-A  +  «■  a)]  =  Oim  >  1  <  k  <  K  —  1  . 


Both  (3.6.6)  and  (3.6.7)  provides  a  relation  between  the  vectors  7 Tk  and  Kk-i  for 
1  <  k  <  K.  However,  neither  of  these  relations  yield  a  recursive  solution  for  the 
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vectors  7Tjt,  1  <  k  <  K,  since  all  the  matrices  in  these  equations  that  are  in  square 
brackets  are  singular  as  discussed  in  the  discrete-time  case. 

Recall  the  definitions  of  the  matrices  M  and  N  given  in  (2.3.6).  Equation 
(3.6.6b)  can  now  be  rewritten  as 

7Tk  N  =  ix k  [  ( Jm  -  em  (3)  <g>  A  +  B  ®  Ii] 

=  -TTfc  [b/3  ®  Ii]  -  TTfc-1  [(Jm  -  em/3)  ®  a  a]  ,  1  <  A;  <  K  ,  (3.6.8) 
=  -TTfc  [b/3  <g>  (I;  -  ej  a)]  -  TXk-\[Im  ®  a  a]  ,  1  <k<K,  (3.6.9) 

where  the  last  equality  is  obtained  by  direct  substitution  of  (3.6.5)  into  (3.6.8). 
Similarly,  use  of  (3.6.6a)  and  (3.6.3a)  gives 

7Ti  N  =  -7Ti  [b/3  <g>  Ii\  —  7T0  [/?  ®  A]  .  (3.8.10) 

Moreover,  (3.6.1a)  and  (3.6.7)  combine  to  readily  yield 

7TfcM  =  — 7Tfc  [Jm  ®  a  a]  -  iTk+1  [b/3  <g>  (/;  —  e/o:)]  1  <  A:  <  K  -  1  ,  (3.6.11) 

whence 

TTk  N  =  'Kk-I  M  ,  1  <  k  <  K  .  (3.6.12) 

by  direct  inspection  of  (3.6.9)  and  (3.6.11). 

Since  the  matrices  iV  and  M  are  both  invertible  owing  to  Lemma  2.3.19.,  it 
follows  from  (3.6.10),  (3.6.3a)  and  (3.6. 3e)  that 

7T i  =  7To  (/?  <g>  A)  N-1 

■nk  =  TTk-\  M N~l  l<k<K  (3.6.13) 

XK  = -Kk-I  {Im®  a)  B”1  . 
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Postmultiplication  of  (3.6.3b)-(3.6.3d)  by  ( em®Ii )  and  of  (3.6.3d)  by  (em®o:) 
and  summing  over  k,  1  <  k  <  K  —  1,  readily  give  the  relation 

^ti-q  +  nk{em  <S>  II)  ^  (i  +  fla)  =0  .  (3.6.14) 

Equations  (3.6.13)  and  (3.6.14)  combine  to  give  the  main  result  which  is  sum¬ 
marized  in  the  following  theorem,  whose  proof  goes  along  the  same  lines  as  the 
proof  of  Theorem  3.3.7. 

Theorem  3.6.2  :  If  the  1  X  l  row  vector  x  is  the  unique  solution  to  the  equation 

x  (A  +  aa)  —  0;  ,  xe\  —  1  ,  (3.6.15) 

then  the  invariant  probabilty  distribution  vector  ir  —  (tto,  . . .  ,7Tk)  has  the  following 
matrix  geometric  form 

7Tfc  =  7T0  S  R fc~1  1  <  k  <  K  (3.6.16a) 

7T*  =  Jro  S  RK~2  U  ,  (3.6.166) 

where  the  vector  tto  satisfies  the  equation 

7r0  Z  —  x  .  (3.6.17) 

The  matrices  R,S,  U  and  Z  are  defined  through  the  equations 


M  =  B  0  {Ii  -  ei  a)  +  Im  Z)  A 
N  =  {Im  ~  emP)  ®  A  +  B  ®  h 
R  —  M  N~l 
S  =  [(3  ®  A\  N-1 
U  =  -(im  <S>  a)  B~l 

W  =  h+  [eK  S  Rk~X]  (Cm  ®  II) 
z  =  W  +  S  Rk~2  Uemx 


ml  x  ml  matrix, 
ml  x  ml  matrix, 
ml  xml  matrix, 
l  X  ml  matrix, 
ml  x  l  matrix, 

l  x  l  matrix, 
l  x  l  matrix. 
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CHAPTER  IV 


TWO  NODE  SYSTEM  WITH 
GEOMETRIC  AND  PHASE  TYPE  SERVERS 

IV. 1.  Introduction  : 

In  this  chapter,  a  special  case  of  the  model  studied  in  Chapter  III  is  considered 
when  one  of  the  servers  is  geometric.  The  discussion  focuses  on  the  situation  where 
the  first  and  second  node  servers  have  geometric  and  phase  type  service  distribu¬ 
tions,  respectively.  The  case  when  the  order  of  the  servers  is  reversed  is  only  briefly 
outlined  as  the  results  of  the  previous  chapter  clearly  hold  in  this  case.  A  system 
state  process  is  introduced  and  its  probabilistic  structure  is  carefully  described. 
For  this  special  case,  unlike  for  the  general  model  of  Chapter  III,  the  underlying 
Markov  chain  is  shown  to  always  have  a  single  ergodic  class,  whence  a  unique  in¬ 
variant  probability  vector.  The  possibility  of  having  transient  states  is  established 
and  these  transient  states  are  identified  in  terms  of  the  PH- representation  of  the 
PH-server.  Necessary  and  sufficient  conditions  are  given  for  the  irreducibility  of 
this  Markov  chain.  Explicit  expressions  for  the  unique  invariant  probability  vector 
are  obtained  in  matrix- geometric  form  and  attempts  are  made  to  get  an  expression 
for  the  (average)  system  throughput,  in  order  to  study  its  behaviour  as  a  function 
of  the  intermediate  buffer  capacity.  The  discussion  of  the  discrete-time  model  con¬ 
cludes  by  applying  the  results  to  some  specific  PH-type  distributions.  Finally,  the 
continuous-time  formulation  of  the  model  is  briefly  discussed  and  similar  results  are 
obtained:  As  in  Chapter  III,  the  irreducibility  of  the  underlying  continuous-time 
Markov  process  is  established  and  the  unique  invariant  vector  is  given  in  matrix 
geometric  form. 
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IV. 2.  The  discrete-time  model  (Geometric/PH)  : 

The  model  to  be  discussed  consists  of  two  nodes  separated  by  a  finite  inter¬ 
mediate  buffer  of  capacity  K,  i.  e.,  there  are  exactly  K  positions  in  the  buffer, 
inclusive  of  the  one  taken  by  the  job  in  service  at  the  second  node  server.  There  is 
an  infinite  supply  of  job  units  available  in  front  of  the  first  node  server,  which  has 
geometric  service  time  distribution  of  parameter  p,  with  0  <  p  <  1.  Moreover,  the 
second  node  server  never  gets  blocked  and  has  a  PH-type  service  time  distribution 
with  representation  (ct,Q)  of  order  m,  the  notation  being  the  one  introduced  in 
Chapter  II.  The  immediate  blocking  strategy  is  again  adopted. 

The  state  space  of  this  system  is  naturally  defined  to  be  the  set  E  =  {0}  U 
{1,2,...,  JT}x  {1,2, . . . ,m},  i.  e., 

f  {k,j)  ,  1  <  k  <  K,  1  <  j  <  m, 

E=\ 

(  0  ,  k  =  0, 

where  k  and  j  indicate  the  buffer  content  and  the  service  phase  of  the  second  node 
server,  respectively.  When  the  buffer  is  empty,  the  second  node  server  has  no  jobs  to 
process  and  its  phase  is  thus  not  defined;  the  corresponding  state  is  indicated  simply 
by  0.  Note  that  E  is  the  state-space  of  a  Markov  chain,  the  so-called  system  process 
which  is  different  from  the  one  given  in  Chapter  III  owing  to  the  “memoryless” 
nature  of  geometric  distribution. 

The  invariant  probability  vector  is  denoted  by  the  1  x  (K  •  m  +  l)  row  vector 
7 r,  which  is  partitioned  into  K  +  1  blocks  of  components,  say,  7r  =  (7r0,7rx, . . . ,  ttjrt), 
with  first  entry  7To  being  scalar  and  TVk,  1  <  k  <  K,  being  1  X  m  row  vectors.  The 
jth  entry  of  7r/c,  denoted  by  7 r^y ,  represents  the  invariant  probability  of  the  state 
{k,j),  1  <  k  <  K,  1  <  j  <  m,  while  7ro  is  the  invariant  probability  of  having  an 
empty  buffer. 
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IV. 3.  Analysis  of  the  discrete-time  model  : 

If  the  states  are  ordered  lexicographically,  say  in  the  order  0,  (1, 1),  (1, 2), , 
(1,  m),  (2, 1), . . . ,  (2,  m), . . . ,  (K,  l), . . . ,  (K,  m),  the  corresponding  one-step  transi¬ 
tion  matrix  T  is  a  (K  •  m  +  1)  x  (K  ■  m  +  l)  block  tridiagonal  matrix.  If  Tkltk2  again 
denotes  the  block  corresponding  to  transitions  from  queue  size  k\  to  queue  size  k2, 
then 

Ak,k-i  =  ppa  l  <  k  <  K, 

■Ak,k+ 1  —  pQ  1  —  k  <C  K , 

Ak,k  —  pQ  +  ppa  1  <  k  <  K, 

where  each  block  is  an  m  x  m  matrix  and  /Z  is  used  for  1  —  p.  For  the  boundary 
states,  the  entries  are 


13. 

II 

o_ 

o' 

scalar, 

Mjq  =  pp 

m  x  1  column  vector, 

O 

II 

P 

1  x  m  row  vector, 

Ak,k- i  =  P<* 

m  x  m  matrix, 

Ak,k  —  Q 

m  x  m  matrix. 

The  resulting  matrix  is  thus 
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(  h 


jua 

ftp  JlQ  +  ppa  pQ 

ppa  JlQ  +  ppa  pQ 


\ 


T  = 


(4.3.1) 


ppa  pQ  +  ppa  pQ 

V  pa.  Q  J 

The  next  theorem  gives  a  necessary  and  sufficient  condition  for  the  irreducibil- 
ity  of  the  matrix  T  and  identifies  its  transient  and  ergodic  states  in  terms  of  the 
properties  of  the  matrix  Q.  The  corresponding  invariant  probability  vector  is  shown 
to  be  unique ,  and  is  obtained  explicitly  in  matrix  geometric  form. 

Theorem  4.3.1.  :  The  Markov  chain  with  one-step  probability  transition  matrix 
T  is  irreducible  if  and  only  if  the  index  set 


T  :=  {l  <  j  <  m  :  Qij  =  0  for  all  1  <  i  <  m} 


is  empty.  Moreover,  if  T  ^  0  then  the  set  of  states  ©  :=  {( K,j )  :  j  G  T}  will  be 
transient  and  the  rest  of  the  states  will  form  a  single  irreducible  class. 

Proof  :  As  in  Chapter  III,  let  the  sets  Ek,  0  <  k  <  K,  be  defined  by 


Ek  :=  { 


{x  e  E  :  x  —  ( k,j ),  1  <j<  m}, 

{0}, 


0  <  k  <  K , 
k  =  0. 


From  the  structure  of  the  matrix  T,  the  transitions  among  the  states  within  Ek,  0  < 
k  <  K,  are  clearly  governed  by  the  directed  graph  G(pQ  +  ppa).  By  the  irreducibil- 
ity  assumption  on  the  PH-representation,  the  matrix  Q  +  pa  is  irreducible,  and  so  is 
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the  matrix  JZQ+ppa  by  Lemma  2.3.3;  the  states  in  each  component  Ek,  0  <  k  <  K, 
therefore  communicate  with  each  other,  without  leaving  Ek •  On  the  other  hand, 
Q  >  0  and  pa  >  0,  since  both  a  >  0  and  p  >  0  as  discussed  in  Section  2.2.  There¬ 
fore  the  sets  Ek,  0  <  k  <  K,  are  reachable  from  each  other,  whence  the  set  E  \  Ek 
is  composed  of  states  that  communicate  with  each  other  without  leaving  it. 

Since  the  transitions  to  buffer  size  K  are  due  to  a  service  completion  in  the 
geometric  server  only ,  the  set  O  by  its  very  definition  can  never  be  reached  from 
the  set  E\Q.  On  the  other  hand,  all  the  states  in  the  set  Ek  \  ©  communicate  with 
all  the  states  in  the  set  Ek- i  through  a  service  completion  in  either  of  the  servers 
owing  to  the  irreducibility  of  the  PH-representation.  Therefore,  the  set  E\Q  form 
a  single  irreducible  class  for  the  state  set  E,  whereas  the  set  0  is  the  transient  class 
of  the  Markov  chain,  and  the  statement  of  the  theorem  readily  follows. 

A 

The  next  corollary  is  now  an  immediate  consequence  of  Theorems  4.3.1  and 
2.3.14. 

Corollary  4.3.2.  :  The  invariant  probability  distribution  of  the  Markov  chain  with 
one-step  transition  matrix  T  is  unique. 

In  order  to  emphasize  the  simplicity  of  this  model  as  it  compares  to  the  model 
of  Chapter  III,  the  unique  invariant  probability  vector  is  obtained  by  direct  manupi- 
lations,  without  specializing  Theorem  3.3.7  to  the  case  where  A  =  Ji,  a  =  1  and 
a  —  p,  although  this  would  give  the  same  result. 

In  order  to  obtain  this  unique  solution  vector,  the  equation 

7T  T  =  7T  (4.3.2) 

is  rewritten  explicitly  in  terms  of  the  block  entries  of  the  matrix  T  and  of  the  vector 
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7T,  in  the  form 

JL'K  0  +  M7Ti  P  =  7To  (4.3.3a) 

p  7T0  a  +  7Ti  [/I  Q  +  p  p  a]  +  p  ^2  P  &  =  (4.3.36) 

^7Ta;_iQ  +  7rfc[7TQ  + /ipa)  + /J7rfc+xpo:  =  7Tfc  1  <  fc  <  K  —  1  (4.3.3c) 

H’VK-iQ  +  ttk-i[pQ  +  PP«]  +  nKpct  -  7TK-1  (4.3.3d) 

L^k-iQ  +  kkQ  —  KK  •  (4.3. 3e) 

Postmultiplication  of  equation  (4.3.3c)  by  em  and  use  of  the  simple  identities 

Qem  =  em  -  p  and  aem  =  1  (4.3.4) 

give 

Jink+iP  ~  imk{em  -  p)  =JlTCkP  ~  nnk-i{em  ~  p)  ,  l  <  k  <  K  -  1.  (4.3.5) 

With  the  notation, 

qffc  :=  -  M7Tfc_i(ew  -  p)  ,  1  <  k  <  K, 

the  relation  (4.3.5)  takes  the  equivalent  form 

12=13  =  •■•  =  IK-2-  (4.3.6) 

Now,  upon  post  multiplying  (4.3.3b)  with  em  and  using  (4.3.3a),  it  follows  that 

12  =  M7T2P  “  At7ri(em  —  p)  =  0.  (4.3.7) 

Similar  calculations  in  equations  (4.3.3d)  and  (4.3.3e)  lead  to 

Ik-i  =  0  ?  (4.3.8) 
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and  (4. 3.6), (4. 3. 7)  and  (4.3.8)  thus  combine  to  yield 

=  0  ,  1  <  k  <  K  .  (4.3.9) 

Consequently, 

')ka  =  0m  or  Jo7Tk+ipa  =  ~  p)a,  1  <  k  <  K,  (4.3.10) 

and  substitution  of  (4.3.10)  into  (4.3.3c)  gives 

plX k — PQ  P^TYl^\  5  1  k  <  If  •  (4.3.11) 

Note  that  (4.3.11)  agrees  with  (3.3.18)  since  for  this  special  case,  M  =  pQ  and 

N  —  ( lyn  pQ 

As  readily  observed,  the  m  x  m  matrix  ( Im  —  pQ  —  pema)  is  stable,  thus 
nonsingular,  and  for  ease  of  notation,  it  is  convenient  to  pose 

S  !“  p  (/^  pQ  *  pemoi)  (4.3.12a) 

R:=QS  .  (4.3.126) 

With  this  notation,  (4.3.11)  takes  the  equivalent  form 

7Tfc  =  7r*_  1  R,  1  <  k  <  K.  (4.3.13) 

so 

7rfc  =  Ti-i  Rk~l,  1  <  k  <  K  ,  (4.3.14) 

Solving  (4.3.3e)  for  itk  yields 

VK  =  PKK-lQ(Im  ~  Q)~l  ,  (4.3.15) 

while  (4.3.7)  and  (4.3.3b)  lead  to 

7T 1  =  tyqqlS  .  (4.3.16) 
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As  usual,  the  scalar  7To  is  determined  through  the  normalization  condition 

K 

tto  +  Y2  %kem  =  1  •  (4.3.17) 

k=l 

Upon  substituting  (4.3.13)-(4.3.16)  into  (4.3.17),  it  is  a  simple  matter  to  check  that 

7T0  =  (1  +  aS'r(iC)em)“1  ,  (4.3.18) 

where 

K  —  l 

T(K)  —  ^  Rk~1  +  pRK~1(S  —  R)-1.  (4.3.19) 

k- 1 

Nonsingularity  of  the  matrix  ( S  -  R )  in  (4.3.19)  follows  from  the  nonsingularity  of 
the  matrix  (Jm  —  Q)  and  (4.3.12b). 

This  discussion  is  now  summarized  in  the  following  theorem. 

Theorem  4.3.3  :  The  unique  invariant  probability  vector  i r  =  (7r0, 7rls . . . ,  7r k)  is 
given  by 

7T0  =  (1  +  a5T(if)em)_1  ,  (4.3.20a) 

Txk  -  ir0aSRk~1  ,  1  <  k  <  K,  (4.3.206) 

7TK  ~  P^K-lQ{Im  -  Q)~l  (4.3.20 c) 

=  pir0OiSRK~2Q(Im  -  Q)-1  , 

where  S,R  and  T(K)  are  defined  by  equations  (4-8. 12a),  (4.8.12b)  and  (4-8.19), 
respectively. 

From  the  Neuman  expansion 

OO 

S  —  p  \Im  (^  Q  "f  /iCm  ®)]  ^  ''j  (  P  Q  "I-  9-  0  m  Ocfi  ,  (4.3.21) 

i— 0 
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and  from  the  fact  that  (]I  Q  +  ^  em  a)  is  a  positive  matrix,  it  follows  that  S  is  also  a 
positive  matrix,  and  so  is  the  matrix  R.  A  similar  reasoning  shows  that  (Im  —  Q)-1 
is  a  positive  matrix.  Also  1  X  m  row  vector  aS  »  0.  This  can  be  shown  by  the 
following  steps:  Since  0  <  /a  <  1,  it  is  an  easy  exercise  to  check  that  elementwise 
Y2'£Lo{T[Q  +  /*cwa)'  >  Y^iLoiV'QY  +  /Pema:.  In  view  of  this  observation  and  (4.3.21) 

-aS  >  Y^PiaQ1)  +  /**«  •  (4.3.22) 

^  *=o 

If  ctj  >  0  then  (<*£>)/  >  0  owing  to  (4.3.22).  On  the  other  hand  if  ccy  =  0,  1  <  j  <  m 
then 

1  m  oo  oo 

-(«% =  EE T?aiQiij » 

^  /=1  t=0  t=0  l£L * 

where  L*  =  {1  <  /  <  m  :  oti  >  0}  and  L*  ^  0  owing  to  the  assumptions  made 
throughout  the  thesis.  Since  JC  >  0  and  Q  >  0,  (o:S’)y  =  0  if  and  only  if  QJy  =  0 
for  every  l  £  L*  and  i,  0  <  i  <  oo.  But  since  j  is  not  in  L* ,  if  Q]y  =  0  for  every 
l  in  L*  and  i,  then  the  state  j  of  the  PH-representation  is  not  reachable  from  the 
set  L*  in  finite  number  of  transitions,  thus  contradicting  the  irreducibility  of  the 
PH-representation.  Whence  the  inequality  aS  >>  0  holds. 

In  view  of  the  above  conclusion  the  analytical  results  which  were  obtained  in 
Theorem  4.3.3  readily  check  with  the  statement  of  Theorem  4.3.2:  Indeed,  a  similar 
argument  to  the  one  given  above  shows  that  the  nonnegative  matrix  R  =  QS  has  no 
zero  column  and  since  aS  >>  0,  from  (4.3.20b)  the  inequality  >>  0,  0  <  k  <  K, 
easily  follows.  In  particular,  kk-i  >>  0  and  if  the  jth  column  of  the  matrix  Q  has 
all  zero  entries,  then  clearly  every  matrix  Q\  i  >  1,  will  have  all  zero  entries  in  the 
jth  column,  and  so  does  the  matrix  Q(Im  —  Q)~1  since 

Q[Im  ~  Q)  1  =  Q  +  Q2  +  Q3  +  . . .  . 
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x  =  0  for  (Jm  —  11Q)  is  nonsingular.  Therefore,  the  matrix  (Im  —  —  fj.ema )  is 

nonsingular,  and  so  is  the  matrix  S. 


The  effect  of  reversing  the  order  of  the  servers  discussed  in  Section  III. 5  for 
the  more  general  model  clearly  still  holds  for  this  special  case.  Denoting  the  service 
phase  of  the  PH-type  server  and  the  buffer  size  at  steady  state  by  the  random 
variables  PH  and  <7,  respectively,  equation  (3.5.4)  now  takes  the  form 

P{PH  =  j,  C  =  k}  =  Pr{PH  =  j,  C  =  K  -  k}  ,  1  <  j  <  m,  0  <  k  <  K  , 
P{C  =  0}  =  Pr{C  =  K} 

where  Pr  again  corresponds  to  the  probability  measure  when  the  order  of  the  servers 
is  reversed. 
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IV.4.  System  throughput  and  some  concavity  results  : 

From  the  exact  analytical  expressions  for  the  steady  state  probabilities,  an 
explicit  expression  for  the  average  system  throughput  is  developed  as  a  function  of 
the  intermediate  buffer  size  K. 

In  terms  of  the  parameters  defined  earlier,  the  average  system  throughput 
Tr(K),  when  the  buffer  size  is  K,  is  defined  as  the  departure  probability  of  a  job 
from  the  system  during  a  time  slot,  and  is  given  by  the  expression 

K 

Tr{K)  =  Yl'KkP  '  (4.4.1) 

/c— 1 


From  equation  (4.3.20),  it  readly  follows  that 


Tr{K)  = 


a  S  T(K)  p 
1  +  aS  T(K)  em 


where  T(K)  is  defined  by  (4.3.19). 

Lemma  4.4. X  :  IfT(K)  is  defined  as  in  equation  (4-8.19),  then 


T{K  +  1)-T{K)=»Rk-1  ema{Im-Q)~l  ,  K  >  1, 


holds  and  T(K )  increases  (elementwise)  with  K. 

Proof  :  From  (4.3.21),  simple  algebra  yields 
T{K  +  1)  -  T(K)  =Im-  (Im  -  R )  T{K) 


(4.4.2) 


(4.4.3) 


'  K- 1 

=  Im  ~  ( Im  ~R)  J2  ^ 1  +  dRK~1  {S  -  R)-1 


=  RK~l 

[  Im 

-fi{Im-R)  (5-E)"1] 

=  Rk-' 

[S- 

-Iilm-VR]  {S-R)-1 

=  rk~1 

[Im 

-US-1  -JlQ]  ( Im-Q)~ 1 

1 

a, 

II 

em 

O  {Im  ~~  Q)  j 
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and  the  result  readily  follows  since  the  right  handside  of  equation  (4.4.3)  is  a  positive 
matrix. 

A 

To  show  the  integer-concavity  of  the  throughput  as  a  function  of  the  buffer  size, 
Tr(K  +  1)  —  Tr(K )  must  be  shown  to  decrease  as  K  increases.  From  (4.4.2),  it 
follows  that 

Tr(K  +  1)  -  Tr(K)  (4.4.4) 

aS  [T(K  +  1)  -  T{K)}  p  +  aS  T(K  +  1)  [pe£  -  empT ]  T{K)t  ( aS)T 
(1  +  aS  T(K)  em)  (l  +  aST{K  +  1)  em) 

Although  the  integer  concavity  of  the  throughput  is  intutively  plauisible,  this  could 
only  be  shown  for  the  case  when  both  servers  are  geometric,  owing  to  algebraic 
difficulties.  In  this  simple  case  since  e\  =  1  and  p  is  a  scalar,  pe\  =  e\ pT  and  the 
second  term  in  the  numerator  of  (4.4.4)  is  thus  zero.  The  equation  takes  the  form 


Tr(K  +  1)  -  Tr(K)  = 


aS  \T{K  +  1)-T(K)}  p 
(1  +  aS  T{K)  em)  (1  +  aS  T{K  +  1)  em)  ’ 


(4.4.5) 


Tr(K  +  1)  -  Tr(K)  _  aS  [T{K  +  l)  -  T{K)\  p  1  +  aST(K  -  1)  em 
Tr(K)  -  Tr(K  -  1)  “  (T(if)  -  T(K  -  1)]  p  '  1  +  aS  T(K  +  1)  em  ' 


The  second  factor  of  (4.4.6)  is  always  less  than  one  owing  to  Lemma  4.4.1 
Lemma  4.4.2  :  For  a  two  node  blocking  system  with  geometric  servers  at  each 
node,  the  system  throughput  is  integer-concave  in  the  intermediate  buffer  size. 
Proof  :  When  both  servers  are  geometric,  with  A  being  the  rate  of  the  second  node 
server,  p  =  A,  Q  =  A,  a  —  1,  S  —  ^4=,  and  R  =  and  (4.4.6)  reduces  to 


Tr(K  +  1)  —  Tr(K)  =  l  +  ^T(K-l) 
Tr(K)  -  Tr(K  -  1)  '  1  +  £=  T(K  +  l)  ' 
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When  fi  <  A,  or  equivalently  R  <  1,  the  right  hand  side  of  equation  (4.4.7)  is  less 
than  one  owing  to  Lemma  4.4.1.  For  R  >  1,  the  recursion  (4.3.22),  after  some 
cancellations,  readily  yields 


Tr(K  -I  1)  -  Tr{K)  (-»/»)  + -g,T(K) 
Tr(K)-Tr(K-  1)  1  +  +  ,f=  R  T  (K) 


whence 

Tr(K  +  1)  -  Tr{K )  _  (— /x/m)  +  ^  T(if) 

rr(A-)  -  rr(AT  -  1)  <  1  +  ft  +  ^  T(K) 


and  the  throughput  is  thus  integer-concave. 


(4.4.8) 


A 
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IV. 5  Numerical  examples  : 


To  see  the  effects  of  buffer  size  and  stochastic  variability  of  the  PH-type  server 
on  the  system  throughput,  (4.4.2)  is  evaluated  for  different  types  of  distributions. 
The  reader  is  referred  to  (2.2.5)-(2.2.7)  for  the  representations  of  these  distributions. 
In  all  cases  the  first  node  server  had  geometric  service  distribution  with  (j,  =  0.5. 
The  following  distributions  and  numerical  values  were  used  for  the  second  node 
server: 

i.  Deterministic  (5  units), 

ii.  Negative  Binomial  with  three  transient  phases  (NBs),  with  q  12  =  0.75, 

923  —  0.5,  and  934  =  0.6,  the  forth  phase  being  the  absorbing  phase; 

iii.  Geometric  with  rate  A  =  0.2;  and 

iv.  Hypergeometric  with  three  transient  phases  (HG 3),  with  qi4  =  0.25, 

924  =  0.15  and  934  =  0.2,  the  forth  phase  being  again  the  absorbing  phase. 

The  initialization  vector  was  a  =  (0.5, 0.3, 0.2). 

The  cases  are  numbered  in  increasing  order  with  the  variance  of  the  service 
time  distribution  of  the  PH-type  server.  Expected  service  time  of  the  PH-type 
server  is  the  same  in  all  cases  and  is  equal  to  5  units.  The  resuts  are  summarized 
in  Table  4.5.1.  For  each  PH-type  server,  the  columns  indicate  that  the  throughput 
is  integer-concave  in  buffer  size,  whereas  the  rows  indicate  that  for  fixed  buffer 
size,  throughput  increases  as  the  service  time  distribution  of  the  second  node  server 
becomes  less  variable. 
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THROUGHPUT  AS  A  FUNCTION  OF  BUFFER  SIZE 


buffer  size 

deterministic 

nb3 

geometric 

HGZ 

1 

0.142857 

0.142857 

0.142857 

0.142857 

2 

0.197531 

0.195804 

0.187500 

0.187093 

3 

0.199907 

0.199714 

0.196970 

0.196733 

4 

0.199997 

0.199980 

0.199248 

0.199152 

5 

0.200000 

0.199999 

0.199812 

0.199778 

7 

0.200000 

0.200000 

0.199988 

0.199985 

10 

0.200000 

0.200000 

0.200000 

0.200000 

expected  service  time  of  the 
first  (geometric)  server  =2 
second  (PH-type)  server  =5 

Table  4.5.1 


-  70 


IV. 6  The  continuous-time  formulation  : 


In  this  section,  the  continous-time  formulation  of  the  model  of  Section  4.2  is 
presented.  Theorem  3.6.1  holds  in  that  the  underlying  continuous-time  Markov 
chain  is  always  irreducible.  The  service  distribution  of  the  PH-type  server  is  again 
represented  by  the  pair  (a,Q),  while  the  exponential  server  operates  at  rate  p. 

The  states  of  the  Markov  chain  are  defined  as  in  Section  3.  The  states  be¬ 
ing  considered  in  the  usual  lexicographical  order,  the  corresponding  infinitesimal 
generator  matrix  T  takes  the  form 

—p  p  a 
P  Q  p  I'm  p  dm 

pa  Q  p  Irn  p  Im 

poc  Q  p  I  rn  p  Irn 
pa  Q 

and  the  equation  %T  —  OKm+i  satisfied  by  the  invariant  vector  can  be  rewritten  as 


—pir o  +  7Ti  p  —  0  (4.6.2a) 

p  7T0  a  +  7T!  (Q  -  p  Im)  +  7T2  p  a  =  0m  (4.6.26) 

piTk-1 +Kk{Q  ~  plm)  +  Kk+ipa  =  Om  ,  l<k<K,  (4.6.2c) 
PKK-1  +  7TK  Q  =  0m  •  (4. 6. 2d) 


As  in  the  discrete-time  situation,  postmultiplication  of  each  equation  in  (4.6.2)  by 
em,  after  simplifications,  gives 

7Ti  p  —  pTVo  =  0 

7Tk+i  p  -  pKk  em  =  o  ,  1  <  i  <  K  . 
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(4.6.3a) 

(4.6.36) 


Postmultiplication  of  (4.6.3)  by  a  and  use  of  (4.6.2b)-(4.6.2c)  and  of  the  boundary 
equations  (4.6.2a)  and  (4.6. 2d)  give 

/j,Tr0a  =  7Ti  (/a  Im  -  /a  em  a  -  Q)  ,  (4.6.4a) 

H Ttk-i  =7 Tjt  (/x7m  -/iema-<5)  ,  1  <  k  <  K  ,  (4.6.46) 

Mttk- i  =  -kk  Q  •  (4.6.4c) 

By  following  the  same  arguments  that  lead  to  the  nonsingularity  of  the  matrix  S  in 
discrete-time  model  of  Section  3,  it  can  be  shown  that  the  matrix  (fx  Im  —  ij,em  a—Q ) 
is  nonsingular.  If  the  matrix  R  is  defined  by 


R  —  /a  (/a  /m  /a  em  cl  £j)  ,  (4.6.5) 

then  (4.6.4)  has  a  solution  in  matrix  geometric  for  given  by 

tti  =  Tip  olR  ,  (4.6.6a) 

Tffc  =  TTi  Rk~ 1  ,  1  <  k  <  K  ,  (4.6.66) 

nK  = ,  (4.6.6c) 

The  scalar  7ro  is  now  obtained  through  the  standard  normalization  condition  as 

7r0  =  (l  +  aT{K)em)-1  ,  (4.6.7) 


where 


K- 1 

r(if)  =  Ri  Q~l  ■  (4.6.8) 

1=1 

Since  by  Lemma  2.3.11  the  matrix  —  Q  is  a  nonsingular  M-matrix,  its  inverse  is  a 
nonnegative  matrix  [10]  while  the  matrix  R  can  be  seen  to  be  a  nonnegative  matrix 
through  its  Neuman  expansion.  Therefore,  7To  given  in  (4.6.7)  is  strictly  positive. 
The  discussion  is  summarized  in  the  following  theorem. 
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Theorem  4.6.1. 

:  The  unique  invariant  probability  vector  7r  =  (7To,. 

is 

given  by 

tt0  =  (l  +  ocT(K)  em)-1  , 

(4.6.9  a) 

—  7To  ot  Rl  ,  1  <  i  <  K  , 

(4.6.96) 

kk  —  aRK~1  Q-1  , 

(4.6.9c) 

where  R  and  T(K)  are  defined  by  equations  (4-6.5)  and  (4-6.8),  respectively. 
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CHAPTER  V 


TWO  NODE  SYSTEM  WITH  PHASE  TYPE  SERVERS 
AND  AN  ARRIVAL  PROCESS  TO  A  FINITE  BUFFER 

V.l.  Introduction  : 

In  this  chapter,  a  two  node  system  with  PH-type  servers  at  both  nodes  is  again 
considered.  This  time,  a  finite  capacity  queue  is  allowed  in  front  of  the  first  node 
server  in  order  to  capture  the  situation  of  a  Bernoulli  arrival  stream  to  the  system. 
In  Section  2,  a  system  state  process  is  defined  and  the  corresponding  one-step  prob¬ 
ability  transition  matrix  is  given.  In  Section  3,  necessary  and  sufficient  conditions 
for  the  irreducibility  of  the  Markov  chain  are  obtained  in  terms  of  the  system  pa¬ 
rameters.  Unlike  for  the  model  of  Chapter  III,  the  invariant  probability  vector  is 
shown  to  always  be  unique ,  even  in  the  discrete-time  formulation,  and  is  obtained 
in  matrix  geometric  form  by  grouping  the  states  in  pairs.  The  joint  queue  length 
distribution  is  then  easily  obtained  as  entries  of  this  invariant  probability  vector.  A 
continuous-time  formulation  of  the  same  model  is  discussed  in  Section  4,  where  the 
underlying  Markov  process  is  shown  to  be  irreducible ,  and  the  unique  invariant  vec¬ 
tor  is  obtained  in  matrix  geometric  form  by  using  the  solution  technique  of  Section 
3. 
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V.2.  The  discrete-time  model  : 

The  model  consists  of  two  nodes  separated  by  finite  capacity  buffers  of  sizes  K i 
and  K2  in  front  of  the  first  and  second  node  servers,  respectively,  including  the  jobs 
being  served  by  these  servers.  Each  node  is  attended  by  a  single  PH-type  server 
with  irreducible  representations  {a.  A)  and  (fi,B),  at  the  first  and  second  node, 
respectively.  The  row  vectors  a  and  ft  and  the  matrices  A  and  B  are  of  dimensions 
lx/,  1  x  m,  l  x  /  and  m  x  m,  respectively.  The  corresponding  l  x  1  and  m  x  1 
column  vectors  of  absorption  probabilities  for  the  first  and  the  second  node  server 
are  denoted  by  a  and  6,  respectively.  A  Bernoulli  arrival  stream  with  parameter  r) 
feeds  into  the  first  buffer  under  the  assumption  that  arrivals  which  see  a  full  buffer 
are  lost.  It  is  also  assumed  that  the  second  server  is  never  blocked,  and  that  the 
immediate  blocking  strategy  is  enforced  for  the  first  server. 

The  state-space  of  the  system  is  naturally  defined  to  be  the  set  E  given  by 


(ki,k2,i,j), 

1  < 

k  1 

rH 

* 

V! 

1  <  <  K2 

( /c  1 , 0 ,  i) , 

1  < 

ki 

<KU 

O 

II 

IN 

( kuK2,j ), 

1  < 

ki 

<KU 

k2  =  K2, 

(0,k2,j), 

ki 

=  0, 

,  1  ^  k2  <  K2, 

(0,0)  , 

ki  = 

=  0, 

,  k2  = 

0, 

for  1  <  i  <  /  and  1  <  j  <  m.  Here,  k  1  and  k2  represent  the  numbers  of  jobs  in 
buffer  one  and  two,  respectively,  while  i  and  j  represent  the  service  phases  at  the 
first  and  second  servers,  respectively.  Note  that  the  phase  of  the  first  server  is  not 
defined  when  it  has  no  jobs  to  process  or  when  it  is  blocked,  and  that  the  phase  of 
the  second  server  is  not  defined  when  the  second  buffer  is  empty. 

For  the  sake  of  compactness,  the  notation 

r  [(K2  —  l)/m  +  /  +  m] ,  s:=K2m  +  l, 
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is  adopted  in  this  chapter. 

The  invariant  probability  vector  of  these  states  is  denoted  by  the  1  x  ( Kir  + 
3)  row  vector  7r,  which  is  partitioned  into  K\  +  1  blocks  of  components,  say 
7T  =  (7To,7ri, . . .  ,71-Kj),  with  7To  being  1  x  s  and  7r*15  0  <  k\  <  K 1,  being  1  x  r 
row  vectors,  respectively.  Each  entry  0  <  ki  <  K 1,  is  of  the  form  7^  = 
(TTfciOjTTfciis  •  •  •  >7rfci-fC2)  where  the  vectors  7r k1k2  is  °f  dimension 

Im  ,  1  <  ki  <  K\ ,  1  <  k2  <  K2, 

l  ,  1  <  ki  <  K\ ,  k2  =  0, 

m  ,  =  0,  1  <  k2  <  K2,  or 

1  <  <  -Kd,  ^2  =  k2, 

1  ,  k  i=0,  k2  =  0, 


and  the  entries  of  each  7 riClk2,  1  <  A:x  <  -Kd,  1  <  k2  <  K2,  are  ordered  as 
(1,1),  (2, 1),  —  ,  (/,  1),  (1,2)  —  ,  —  ,  (/  -  1  ,m),(/,m). 

By  lexicographically  ordering  the  states  as  described  above,  the  one-step  tran¬ 
sition  matrix  P  of  the  underlying  Markov  chain  can  be  put  in  the  form 


/C  D 
E  G  H 
F  G  H 

P  = 

F  G 

V  F 


(5.2.1) 


where  the  block  entries  C ,  D,  and  E  are  of  dimensions  s  x  s,  s  x  r  and  r  x  s, 
respectively,  and  the  matrices  F,  G,  H  and  L  are  of  dimensions  r  x  r.  These 
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matrices  are  given  by 


C  =  rj 


Z1 

b  B 
b(3  B 


V 


bp  B 

b(3  BJ 


D  =  rj 


(  a 

b  ®  a  B  ®  a 

bp  ®  a  B  ®  a 


V 


(  0  /?  ®  a 

b/3  ®  a  B  ®  a 


E  —  rj 


V 


{  0  f3  ®  aa 

b/3  ®  aa  B  ®  aa 


b(3  ®  a  B  ®  a 

b(3  ®  a  B  J 


b/3  ®  a  B  ®  a 

b(3  ®  a  B  ®  a 

0  J 


F  =  rj 


V 


A 


bp  ®  aa  B  ®  aa 

bp  ®  aa  B  ®  a 

0  0  J 


G 


(  ffA  rj(p  ®  aa) 
ff(b®A)  Gd  rj{B  ®  aa) 

fj(bp  ®  A)  Gd  r](B®aa) 


\ 


rj(bp  ®  A)  Gd  rj{B  ®  a) 
f[(bp  ®  a)  fjB  J 
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(  A 

b®A 


H  —  7) 


B  ®A 

bp  ®  A  B  ®  A 


\ 


V 


bp  ®  A  B  ®  A 

bp  ®  a  B  J 


/  A  rj(p®aa) 
b®  A  Ld  r)(B  ®  act ) 

bp  ®  A  Ld  rj(B  ®  aa) 

bp  ®  A  Ld 

V  bp  0  a 


with  the  diagonal  entries  Gd  and  Ld  being  defined  by 


Gd  =  T)  (B  ®  A)  +  rj  (bp  ®  aa)  , 
Ld  =  B  ®  A  +  r)  (bp  ®  aa)  . 


\ 


r)(B  ®  a)  j 
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V.3.  Analysis  of  the  discrete-time  model  : 

A  necessary  and  sufficient  condition  for  the  irreducibility  of  the  Markov  chain 
associated  with  the  matrix  P  of  one-step  transition  probabilities  is  now  studied  and 
the  uniqueness  of  the  corresponding  invariant  probability  vector  is  established. 

If  the  sets  Ekx,  0  <  k\  <  K\,  are  defined  by 

f  f  (ki,k2 1  <  k2  <  K2  ^ 

Ekl  :=\eeE:  e  =  \  {kuO,i),  k2  =  0  \  A  <  h  <  Ku 

1  {(kuK2,j),  k2  —  K2  > 

E0:={eeE:  e  =  (0  ,k2,j),  1  <  k2  <  K2)  U  {(0, 0)}  , 

then  the  sets  E)Cl,  0  <  ki  <  K\,  form  a  partition  of  the  state  space  E  for  the 
Markov  chain.  Since  0  <  r\  <  1,  the  following  three  observations  are  easily  verified: 

(i)  Lemma  2.3.3  quickly  implies  that  the  directed  graphs  of  the  matrices  G,  L  and 
T  have  the  same  topological  structure,  with  T  given  by  (3.3.1). 

(ii)  The  set  E^-i  is  reachable  from  every  state  in  the  set  E^l  and  vice  versa,  for 
1  <  kx  <  Ki. 

(iii)  The  state  (0,0)  is  reachable  from  every  state  in  the  set  Eo. 

The  next  theorem  readily  follows  from  the  observations  (i)-(iii)  by  virtue  of 
Theorem  3.4.5. 

Theorem  5.3.1.  :  If  the  matrix  T  defined  in  Chapter  III  is  irreducible,  then  so  is 
the  matrix  P. 

Next,  even  when  the  matrix  P  is  not  irreducible,  it  is  now  shown  to  have  a 
single  ergodic  class,  whence  the  invariant  probability  distribution  vector  is  always 
unique.  Let  the  K\r  X  K\r  matrix  P  be  obtained  by  deleting  the  first  s  rows  and 

/V 

columns  of  P,  i.  e.,  P  is  the  submatrix  of  P  that  governs  the  transition  mechanism 
within  the  states  in  the  set  E  \  Eq.  Assume  the  directed  graph  G(P )  to  induce 
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several  ergodic  classes  and  a  set  of  transient  states,  as  would  be  the  case  if  T  had 
several  ergodic  classes.  In  view  of  (ii)  the  set  Eo  is  reachable  from  all  of  the  ergodic 
classes  of  E  \  Eo,  whence  by  (iii),  the  state  (0,0)  is  reachable  from  every  ergodic 
class  of  the  set  E\Eo.  On  the  other  hand,  if  (0,0)  — »  e  for  a  state  e  in  E,  then  e  will 
be  in  the  communication  link  between  the  state  (0, 0)  and  the  other  states  of  the 
chain  that  (0,0)  has  access  to,  while  if  (0,0)  -f*  e,  then  e  will  be  a  transient  state 
of  the  chain  since  e  — »  (0, 0)  from  the  above  argument.  Therefore,  in  the  directed 
graph  G(P),  the  set  E(o,o)  :=  {e  G  E  :  (0,0)  — >  e}  U  {(0, 0)}  forms  an  irreducible 
class  while  the  set  E  \  E( 0,o)  forms  a  transient  class. 

The  next  theorem  follows  from  Theorem  2.3.14  and  these  remarks. 

Theorem  5.3.2.  :  The  Markov  chain  with  one-step  transition  matrix  P  always 
has  a  single  ergodic  class,  and  the  invariant  probability  vector  7T  as  defined  above 
is  thus  unique. 


In  order  to  obtain  a  closed  form  expression  for  this  unique  vector  7r,  it  is 
convenient  to  group  the  vectors  717^,  0  <  k\  <  K\,  in  pairs.  With  this  in  mind,  the 
equation  7T  P  —  7r  can  then  be  rewritten  as 


7 T0  (Is  —  C)=7TlE 


7T0  D  T  7Tj  G  T  7T2  F  —  7Ti 


K-.,n,)  (®  °£r)  =(**„**.+.) 

KKi- 1  H  =  7 Tk,  ( Ir  —  L ) 


If  If 

—  F  0rX  r 


(5.3.1a) 

(5.3.16) 

1  <  ki  <  K\  (5.3.1c) 

(5.3. Id) 


In  order  to  get  this  explicit  solution,  nonsingularity  of  the  matrices  ( Is  —  C ) 
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and 


OrXr  | 
Ir  ) 


is  needed.  Since 


/  V_  \ 

-r)b  Im  ~  r)B 

j  _  c  _  -rjbf}  Im  -  rfB 

V  -r}b/3  Im-riB ) 

and  7)  >  0,  Ia  —  C  is  invertible  if  and  only  if  the  matrix  Im  —  r}B  is  invertible,  a  fact 
easily  established  by  a  direct  application  of  Theorem  2.3.20.  This  can  also  be  seen 
by  noting  that  p(B )  <  1  and  hence  0  is  not  an  eigenvalue  of  the  matrix  Im  —  fjB. 
On  the  other  hand,  since 


det  =  det(H)  =  r]r  det(A)  det(B)  [det[B  ®  A)]K2  1 

=  r}r  det(A)(K2~1^m+1  det(B)(K2~^l+1  , 

where  the  last  equality  follows  from  (2. 3. 2d),  it  is  easy  to  see  that  the  matrix 

is  invertible  if  and  only  if  both  A  and  B  are  invertible. 

As  a  result  of  this  discussion,  nonsingularity  of  both  A  and  B  will  be  as¬ 
sumed  for  the  discrete  time  model.  Although  this  may  seem  rather  restrictive, 
many  well-known  discrete  PH-type  distributions  enjoy  this  property,  including  the 
hyperexponential  and  negative  binomial  distributions,  to  name  a  few. 

Theorem  5.3.3.  :  If  the  matrices  A  and  B  are  invertible,  then  the  unique  invariant 
probability  vector  it  —  (7To,  7Ti,  . . . ,  7 vkx  )  has  the  following  form 

7T0  =  TTi  E  {I3  -  C)-1  ,  (5.3.2) 

**!=**,  {{Ir-L)H-\lr)  RK'-k'~l  ,  1  <  *!  <  Kx  (5.3.3) 

TTKi  =  ( xw )-1  x  ,  (5.3.4) 


f  H  0rxr 
Ir 
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where  1  X  r  vector  x  satisfies 


xZ  =  Or  ,  x  >  Oj  (or  x  <  Oj) 


(5.3.5) 


with  the  2  r  X  2  r  and  r  X  r  matrices  R  and  Z  and  the  rxl  vector  w  being  given  by 


r i  i  Fr  1  | 

'  -F  OrXJ  l  G  Ir 


Z  =  ((Jr  -  L)  H-\lr)  RK'~2  (E{1‘  -0)lD  +  G-Ir 


w 


=  ((Ir-L)!!-1,^) 


_ 1 

RKl~2(nIr  )E{Is-C)-1e'+YtRK'-k'-1  (*rT) 

\UrXrJ  ^  V°r/ 


Proof  :  Since  Is  —  C  is  invertible,  (5.3.2)  follows  from  (5.3.1a).  On  the  other  hand, 
(5.3.1c)  takes  the  form 

(ft ki  —  1  j  TTfci  )  (ft k\  j  ftki  + 1 )  -^  )  1  ^1  ^  ddi\  , 


or  equivalently,  by  induction, 

(7Tfcl_l,  TTjfcJ  =  (tTKx-1,  TTKl)RKl~kl  ,  1  <  fci  <  KX  .  (5.3.6) 

From  (5. 3. Id),  it  follows  that 

(ftK1-i,  ftKL )  =  TTiCi  ((Ir  ~  L)  H~l  ,Ir)  ,  (5.3.7) 

and  therefore  (5.3.3)  readily  obtains.  Equations  (5.3.4)  and  (5.3.5)  are  obtained 
by  using  (5.3.2),  (5.3.6)  and  (5.3.7)  in  (5.3.1b)  and  the  standard  normalization 
condition  7r0es  +  J2ki=  l  er  =  1. 

A 
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V.4.  The  continuous-time  formulation  : 

In  this  section,  a  complete  solution,  without  any  additional  assumptions  on 
the  service  distributions,  is  presented  for  the  continuous-time  formulation.  The 
notation  and  state  description  of  Section  2  are  again  used.  The  arrival  process  is 
now  assumed  to  be  Poisson  with  rate  rj.  The  infinitesimal  generator  matrix  P  is 
again  of  the  form 


(C  D 

\ 

E  G 

H 

F 

G  H 

(5.4.1) 


V 


F  G  H 
F  L 


where  the  block  entries  C ,  D,  and  E  have  dimensions  s  x  s,  s  X  r,  and  r  x  s, 
respectively,  while  the  matrices  F,  G,  H  and  L  are  of  dimension  r  x  r.  These 
matrices  are  now  given  by 


n 


c  = 


B  T)  Im 

b/3  B  -  rjlm 


\ 


b/3  B  —  rjlm 

bj3  B  -  plm  ) 
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(a 


D  =  rj 


Im  ® 


V 


\ 


5 


Im®  OL  I 
Im) 


/O  (3  ®  a 
I  0  Im  ®  & 


\ 


E  = 


V 


0  Im  ®  & 

0  Im  ®  & 

o  y 


5 


/  0  (3  ®  aa 
I  0  Im  ®  aa. 


\ 


F  = 


V 


/m  ®  aa 

0  I 


m  ®  ® 

0 


fA-rjli  \ 

b  ®  Ii  Gd 

b(3  ®  h  Gd 

b(3  ®  Ii  Gd 

V  b/3  ®  a  B  —  r}Im  J 


(  A  \ 

b®  Ii  Ld 

bf3  <g>  Ii  Ld 


V 


b(3  ®h  Ld 

b(3  ®  a  B  ) 


and  H  =  rj  Ir.  The  diagonal  entries  of  the  matrices  G  and  L  are  given  by 
Gd  =  B  ®  Ii  +  Im  ®  A  —  r)(Im  ®  Ii )  and  Ld  =  B  ®  Ii  +  Im  ®  A,  respectively. 
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The  observations  (i)-(iii)  made  for  the  discrete-time  model  obviously  still  apply 
to  the  continuous-time  model,  and  the  conclusions  of  Theorem  5.3.1  thus  combine 
with  Theorem  3.6.1  to  give  the  following  result. 

Theorem  5.4.1.  :  The  Markov  process  with  infinitesimal  generator  matrix  P  is 
irreducible,  and  the  invariant  probability  vector  tv  as  defined  above  is  thus  unique. 

In  order  to  obtain  an  expression  for  the  unique  vector  tv,  the  vectors  Tvkl ,  0  < 
ki  <  Ki,  are  again  grouped  in  pairs.  The  equation  n  P  =  O^r+s  can  then  be 
rewritten  in  the  form 

tvqC  —  —tv\  E  (5.4.2a) 

%o  D  tvi  G  +  TV2  F  ~  0r  (5.4.26) 

?!  (TVkl-i,TVkl)  =  (TVkl,TVkl+l)  Orxr)  ’  1  <  kl  <  »  (5-4-3c) 

V^Kx-1  =  -KKx  L  .  (5. 4. 2d) 

In  this  case  the  matrix  H  is  the  identity  matrix,  only  the  nonsingularity  of 
C  is  needed  in  order  to  get  an  explicit  solution.  The  nonsingularity  of  C  again 
follows  from  the  Gershgorin  Circle  Theorem  given  in  Theorem  3.2.20.  Note  that  no 
invertibility  assumption  on  the  matrices  A  or  B  is  needed  for  the  continuous-time 
model.  Proceeding  as  in  the  proof  of  Theorem  5.3.3,  the  following  similar  result 
can  be  obtained. 

Theorem  5.4.2.  :  The  unique  steady  state  probability  vector  tv  =  ( tvq,tv\ ,. . .  j^k,) 
is  given  by  the  equations 


7T0  —  — 7Tl  E  C-1  , 

(5.4.3) 

nki=*K1  L,Ir 

(  Ir  ) 

\ Orxr  J 

,  1  <  ki  <  Ki  (5.4.4) 

tvk !  =  {xw)~1x  , 

(5.4.5) 
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where  1  X  r  vector  x  satisfies 


x  Z  =  Or  ,  x  >>  oj  (or  x  «  oj) 


(5.4.6) 


and  the  2 r  x  2 r  and  r  x  r  matrices  R  and  Z  and  the  r  X  1  vector  u>  being  given  by 


R  = 


-rf-'G  Jr 


-T)  1 F  QrXr  )  ’ 
Z  =  (- ri~lL,Ir )  R 


Kl  —2  [G-EC-'D 


w 


(■ -ri~XLJr ) 


-rK‘~2  (ot)  zc-I'.+  i:'xK‘-k‘-'  (a 


er 

T 

r 


— I™  Cj- 
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CHAPTER  VI 


APPLICATIONS  TO  SERVERS  SUBJECT  TO  FAILURES 

VI. 1.  Introduction  : 

In  this  chapter,  a  class  of  unreliable  servers  with  PH-type  service  and  repair 
time  distributions  is  introduced.  In  Section  2,  the  effective  service  time  distribution 
of  such  servers  is  shown  to  admit  a  PH-type  represention  of  higher  order  so  that 
the  methods  of  the  previous  chapters  apply.  Under  the  irreducibility  assumption  on 
the  service  and  repair  PH-distributions,  necessary  and  sufficient  conditions  for  the 
irreducibility  of  the  effective  service  representation  are  established.  In  Section  3, 
the  situation  where  even  idling  servers  may  be  subject  to  failure  is  considered:  The 
transition  probabilities  among  the  boundary  states  are  explicitly  written  out  for 
this  case  and  an  explicit  solution  is  then  obtained  in  matrix  geometric  form  for  the 
invariant  probabilities  through  algebraic  manupulations  similar  to  the  ones  given  in 
the  previous  chapters.  The  case  when  only  operational  servers  can  fail  is  obtained 
as  a  special  case  of  the  discussion  given  for  the  case  when  idling  servers  can  fail. 
Applications  to  other  models  are  only  briefly  mentioned.  Finally  to  illustrate  the 
ideas,  several  numerical  examples  are  considered  in  Section  4. 
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VI. 2.  Representation  of  The  Effective  Service  Time  Distribution  : 

Consider  the  following  model  for  a  PH-type  server  subject  to  occasional  failures: 
The  service  and  repair  distributions  have  irreducible  PH-representations  (a,  A)  and 
(/?,  B )  of  order  m  and  n,  respectively,  with  the  corresponding  mxl  and  n  x  1  column 
vectors  of  absorption  probabilities  denoted  by  a  and  6,  respectively.  As  soon  as  a 
failure  occurs,  the  repair  process  starts  and  proceeds  according  to  a  PH-type  repair 
distribution.  Let  the  sets  S,  R  and  E  be  defined  by 

S  :=  {si,  1  <  i  <  m},  R  :=  {ry,  1  <  j  <  n},  E  :=  S  U  R  , 

where  st-  and  ry  are  the  ith  service  phase  and  the  jth  repair  phase,  respectively. 
Let  C  and  D  be  m  X  n  and  n  X  m  non-negative  matrices  with  entries  Cty  and 
Dij ,  1  <  i  <  m,  1  <  j  <  n,  respectively,  with  the  property  that  Cen  =  em  and 
Dem  =  en.  Similarly,  let  the  1  x  m  column  vector  /  have  non-negative  entries 
fi,  1  <  i  <  m. 

It  is  assumed  that  when  the  server  is  up  and  in  phase  of  service  i,  it  can 
fail  with  probability  fi,  1  <  i  <  m,  and  the  repair  is  initialized  at  phase  j  with 
probability  C{j ,  1  <  i  <  m,  1  <  j  <  n.  Similarly,  when  the  repair  is  completed, 
i.e.,  whenever  there  is  a  transition  from  a  transient  phase  j  to  the  absorbing  phase 
n  +  1  of  the  repair  distribution,  the  service  restarts  at  a  phase  i  with  probability 
Dji,  1  <  j  <  n,  1  <  i  <  m.  Moreover,  a  failure  at  a  repair  completion  epoch  is 
not  allowed.  In  addition  to  these  fairly  general  transition  mechanisms,  the  server  is 
allowed  to  fail  at  a  service  completion  epoch  with  probability  4>  and  reinitialization 
of  the  repair  phase  is  then  done  according  to  the  probability  distribution  vector  /?. 
The  natural  conditions  <j>  <  1  and  fi  <  1,  1  <  i  <  m,  are  imposed  throughout. 

Under  the  assumptions  made,  it  is  easy  to  see  that  the  effective  service  time 
distribution  of  such  a  server  admits  a  PH-type  distribution.  To  that  end,  consider  a 
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discrete-time  Markov  chain  on  the  state  space  £'u{5m+i},  where  sm+i  is  interpreted 
as  the  instantenous  state  for  the  PH-representation  of  the  (effective)  service.  The 
corresponding  one-step  transition  matrix  P  and  the  initialization  probability  vector 
q  are  of  the  form 

■P=(of+„  l)  >(?'«•»+”+! )  , 

9  =  (<?1 )  92  j  •  •  •  j  Qm+n)  } 

where  Q,  p  and  q  are  of  dimension  (m  +  n)x(m  +  n),(m  +  (i)xl  and  1  X  (m  +  n), 
respectively.  The  equalities 


AjA. 

A  fC\ 

Q  = 

. 

(6.2.1a) 

\^b  D 

B  J 

’-it)  ■ 

(6.2.16) 

q  —  (cj>  a  ,</>/3) 

(6.2.1c) 

readily  follows,  where  the  notation  Ax  :=  diag{x\, . . .  ,xi)  is  used  for  all  x  in  1R1. 
The  relations  A/  em  =  f  and  A&  en  =  b  easily  follows. 

The  effective  service  distribution  of  such  a  server  thus  has  a  PH-representation 
(q,  Q )  of  order  n  +  m.  The  assumption  qm+ 1  =  /3n+ 1  =  0  imply  that  qm+n+i  =  0. 

Lemma  6.2.1.  :  The  PH-representation  ( q,Q )  is  irreducible  if  and  only  if  every 
state  rj  in  the  set  R\R*  is  reachable  from  the  set  R*  under  the  transition  mechanism 
induced  by  G(B),  where 

R*  :={rj  G  R  :rj  is  reachable  from  the  set  S  under  G(Q  +  pq)  }  . 

Moreover,  if  a  state  rj  in  R\R*  is  not  reachable  from  R* ,  rj  is  a  transient  phase 
for  the  PH-representation  ( q,Q ). 
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Proof  :  By  definition,  the  irreducibility  of  the  PH-representation  ( q ,  Q )  is  equiva¬ 
lent  to  the  irreducibilty  of  the  (m  +  n)  x  (m  +  n)  matrix  Q  +  pq,  which  is  readily 
given  by 

(Ay  A  +  <f>  Aj  a  a.  A/  C  +  <f>  kja  /? 

A  bD  B 

Now,  the  property  st-  — >  Si>,  1  <  i,  i'  <  m,  is  a  direct  consequence  of  the  irreduciblity 
of  the  matrix  A jA  +  (f>A.jact,  a  fact  which  follows  from  Lemma  2.2.3  since  by 
assumption  <j>  <  1,  /,•  <  1,  1  <  i  <  m,  and  the  representation  (a,  A)  is  irreducible. 
Therefore,  every  state  s  in  S  communicates  with  any  other  state  in  S  without  leaving 
S .  On  the  other  hand,  since  (7n  —  B )  is  assumed  invertible,  B  is  substochastic  and 
b  ^  0£.  This  fact,  together  with  the  fact  that  the  states  {ri, . . . ,  rn }  are  all  transient 
states  for  the  representation  ( (3 ,  B)  yields  the  access  relation  rj  — >  s;  for  every  rj  in 
R  and  Si  in  S. 

(Sufficiency)  The  sufficiency  part  of  the  first  assertion  of  the  Lemma  now  follows 
from  the  hypothesis,  since  every  ry  in  R  \  R*  is  reachable  from  R* ,  thus  they  are 
communicating  with  the  set  S  U  R* . 

(Necessity)  Follows  trivally  by  the  definition  of  irreducibility  and  the  form  of  the 
matrix  Q  +  pq  in  that  the  transitions  within  the  set  R  are  governed  by  the  matrix 
B  only ,  due  to  the  assumption  that  failures  at  repair  completions  are  not  allowed. 

The  second  part  of  Lemma  6.2.1  also  follows  easily  from  the  above  discussion. 
Since  b  0^,  the  underlying  Markov  chain  will  eventually  leave  the  set  R  and  enter 
the  set  S.  If  ry  in  R  \  R*  is  not  reachable  from  the  set  R*  then  ry  will  never  be 
revisited  and  will  be  a  transient  state  for  the  Markov  chain. 

A 

Since,  ( q ,  Q)  is  constructed  from  basic  building  blocks  and  is  not  given  from  the 
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onset,  no  invertibility  assumptions  are  made  for  the  matrix  Im+n  —  Q ■  However,  a 
sufficient  condition  is  obtained  in  the  following  Lemma. 

Lemma  6.2.2.  :  If  the  PH-representation  ( q,Q )  is  irreducible  then  the  matrix 

Im+n  ~  Q  is  invertible. 

Proof  :  The  directed  graph  G(Q )  may  in  general  induce  several  ergodic  classes. 
However  the  irreducibility  of  the  representation  ( q ,  Q)  implies  that  all  of  these  classes 
communicate  with  each  other  through  sm+i  in  the  access  relation  induced  by  G(Q  + 
pq),  and  therefore,  the  states  in  E  are  all  transient  for  the  Markov  chain  with 
one-step  probability  transition  matrix  P.  On  the  other  hand,  if  G(Q)  induces  a 
single  ergodic  class,  the  states  in  E  are  again  all  transient  since  sm+i  is  indeed  an 
absorbing  state  for  P,  i.  e.,  p  ^  0^+n  from  (6.2.1b),  owing  to  the  assumption  that 
and  /t-  <  1,  1  <  i  <  m.  The  invertibility  of  ( Im+n  —  Q )  is  now  immediate 
since  it  is  equivalent  to  the  statement  that  the  states  in  E  are  transient  for  the 
Markov  chain  with  one-step  probability  transition  matrix  P  [Neuts,  58  p.  45], 

A 


The  representation  of  the  effective  service  time  given  above  for  such  a  faliure 

type  server  subsumes  the  case  when  the  server  is  reliable,  i.  e.,  <f>  =  0,  /  =  0^,  in 

A  +  aa 
A  bD 

also  provides  a  trivial  example  for  the  representation  {q,  Q )  not  to  be  irreducible, 
although  the  representation  (a,  A)  for  the  service  duration  is.  If  the  representation 
(q,  Q )  is  not  irreducible,  Lemma  6.2.1  may  provide  a  general  guideline  in  identi¬ 
fying  the  corresponding  irreducible  representation.  In  the  following  sections  it  is 
assumed  that  the  representation  (q,  Q )  is  irreducible  whence  the  matrix  ( Im+n  —  Q ) 
is  invertible. 

In  some  applications  the  server  may  fail  with  a  positive  probability  at  a  ser- 


0  mXn 

B 


This  special  case 


which  case,  the  matrix  Q  +  pq  takes  the  form  ^ 
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vice  completion  epoch,  i.  e.,  <f>  >  0.  In  that  event,  since  a  ^  0^,  there  exists 
some  i,  1  <  i  <  m,  such  that  a,-  >  0,  whence  Si  — >  ry  for  every  ry  in  the  set 
JE*  :=  {l  <  j  <  n  :  (3j  >  0}  as  the  repair  phase  is  initialized  according  to  (3.  Since 
the  representation  (/ 3,B )  is  irreducible,  every  state  in  R  \  IE*  must  be  reachable 
from  the  set  iE*  since  otherwise  r  will  be  a  transient  state  for  the  matrix  B  +  b(3 
thus  contradicting  the  irreducibility  of  ( /3,B ).  Therefore,  similar  arguments  that 
lead  to  the  sufficiency  part  of  Lemma  6.2.1  show  that  the  representation  ( q ,  Q )  is 
irreducible. 

To  conclude  this  section,  it  is  noteworthy  to  keep  in  mind  that  the  matrices 
C  and  D,  corresponding  to  transition  probabilities  between  the  service  and  repair 
phases,  take  special  forms  depending  on  the  assumptions  made.  For  instance,  if 
upon  completion  of  a  repair,  the  phase  of  service  is  reinitialized  according  to  cc, 
and  similarly  if  upon  a  failure  the  phase  of  repair  is  initiazed  according  to  /?,  then 
C  and  D  take  the  special  forms  C  ~  em  (3  and  D  —  ena.  In  the  case  when 
C  =  em/3,  regardless  of  the  form  of  the  matrix  D,  it  is  an  easy  exercise  to  see  that 
the  representation  ( q ,  Q)  given  by  (6.2.1)  is  irreducible. 
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VI. 3.  Two  Node  System  With  PH- Type  Failure  Servers  : 

In  this  section  model  of  Chapter  III  is  considered  in  the  event  that  the  servers 
are  subject  to  failures  even  when  they  are  idling.  The  first  and  second  node  servers 
have  irreducible  PH-representations  of  the  form  (6.2.1),  denoted  by  ( qi,Qi )  and 
( Q2,Q2 ),  respectively.  The  service  and  repair  PH-representations  are  denoted  by 
the  pairs  (a;,  A{)  and  (/?,-,  Ht),  i  —  1, 2.  It  is  assumed  that  an  idling  server  fails  with 
probability  gi,  i  =  1,2,  and  upon  failure  the  phase  of  repair  is  initialized  according 
to  the  initialization  vector  The  row  vectors  on  and  /?;  and  the  matrices  A{  and 
B{  are  of  dimension  1  x  m;,  1  x  n;,  mi  X  m;  and  X  nt-,  respectively,  for  i  =  1,2. 
The  corresponding  m;  X  1  and  n;  X  1  column  vectors  of  absorption  probabilities  for 
the  service  and  the  repair  distributions  are  denoted  by  a;  and  6;,  respectively,  for 
i  =  1,2.  For  sake  of  compactness,  the  following  notation  is  used  hereafter. 
h  =  {mi  +  ni)  (m2  +  n2)  ,  rx  =  mi  +  ui  , 

hi  =  (mx  +  m)  (1  +  rz2)  ,  r2  =  m2  +  n2  , 

h2  =  (1  +  ni)  (m2  +  n2)  ,  l  =  n2  +  1  . 

As  in  Chapter  III  it  is  assumed  that  the  first  server  never  starves  while  the 
second  is  never  blocked,  and  the  immediate  blocking  strategy  is  adopted.  The 
states  of  the  system  are  denoted  by 

(*,0)  ,  k  —  0,  1  <  *  <  ri, 

(*,0,j)  ,  k  =  0,  1  <  i  <  n,  m2  +  1  <  j  <  r2, 

(*, k,j)  ,  1  <  i  <  ri,  0  <  k  <  K,  and  1  <  j  <  r2, 

(i,  K,j )  ,  k  =  K,  rrn  +  1  <  *  <  n,  1  <  j  <  r2, 

(■ K,j )  ,  k  =  K,  1  <  j  <  r2. 

Here,  k  indicates  the  buffer  size,  while  i  and  j  represent  the  service  or  repair  phase 
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in  the  first  and  the  second  node  server,  respectively.  The  phase  of  service  of  the 
second  node  server  is  not  defined  when  it  has  no  jobs  to  process  and  the  phase  of 
service  of  the  first  node  server  is  not  defined  when  the  buffer  is  full  as  it  is  blocked. 
The  pairs  (*,0),  1  <  i  <  ri,  and  ( K,j ),  1  <  j  <  r2,  correspond  to  states  where  the 
second  and  the  first  node  server,  respectively,  are  functional  but  idle. 

The  invariant  probability  vector  of  these  states  is  denoted  by  the 
1  x  \{K  —  1)  h  +  hi  +  h2\  row  vector  it.  As  in  Chapter  III,  this  vector  is  parti¬ 
tioned  into  K  +  1  blocks  of  components,  say  it  =  (7r0, 7Ti,  . . . ,  ttk),  with  7 r0  being 
1  X  hi,  TT{,  0  <  i  <  K,  being  1  x  h,  and  ttk  being  1  x  h2,  row  vectors. 

By  ordering  the  states  as  in  Chapter  III,  i.  e.,  first  varying  the  index  of  the  first 
server,  the  one-step  state  transition  matrix  T  of  the  underlying  Markov  chain  can 
be  obtained  in  block  tridiagonal  form.  Since  the  effective  service  time  distribution 
of  the  failure  service  is  still  PH-type,  the  intermediate  block  entries  of  the  matrix  T 
is  still  of  the  form  given  in  Chapter  III,  i.  e.,  if  Tkltk2  denote  the  (ki,k-2)-th.  block 
of  the  matrix  T,  0  <  k\,  &2  <  K,  then 

Tk,k-i  =  P2  <*2  ®  Qi  1  <k<K, 

Tk,k  =  Q2  ®  Qi  +  P2  Q=2  ®  Pi  oci  1  <  k  <  K  , 

Tk,k+i  -  Q2  ®  Pi  «i  l<k<K-l, 

where  each  block  is  an  h  X  h  matrix.  For  the  boundary  states  the  entries  are  given 
by 

T°°  =  (j>2  g2]32  ®  Q1  hi  x  hi  matrix, 

Tio  =  P2  [<t> 2  5  <t>2  P2)  ®Q  1  hx  hi  matrix, 

T01  =  ^  ^  ^  ®  Pi  OLi  hxxh  matrix, 

Tk-i,k  =  (<£1  Q2  ®  Pi  ,  $  1  Q2  ®  Pi  Pi)  hxh2  matrix, 
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P‘2  a.2  ®  Oil 
P2  a2  ®  (A6l  Di,Bi) 


hz  x  h  matrix, 


Tk,k  = 


Si  Q 2  9 1  Q2  ®  /?i 

£?2  ®  6i  Q2  ®  -Si 


/12  X  h%  matrix. 


Since  the  effective  service  representations  (<7i,Qi)  and  (92, Q2)  are  both  as¬ 
sumed  irreducible,  the  results  of  Section  III. 4  can  be  used  to  characterize  the  irre- 


ducibility  of  the  Markov  chain  studied  here. 

As  in  Chapter  III,  the  matrices  M  and  N  are  defined  by 

M  :=Ir2  ®  (iri  ®ri  9l)  "t"  Q2  ®  (eri  9l  Q l)  5 
N  :=(Ir2  -  er2  92)  ®  Iri  +  (er2  92  -  Q2)  ®  Ql  , 


(6.3.1a) 

(6.3.16) 


The  invertibility  of  the  matrix  Ih2  —  Tk,k  is  needed.  To  see  this,  note  that  the 

matrix  ^  ^  ^  ,  being  stochastic,  has  eigenvalues  in  the  closed  unit  disc,  while 

the  matrix  Q2  has  eigenvalues  in  the  open  unit  disc  in  the  complex  plane.  It  is  an 
easy  exercise  to  show  that  if  (A,u)  and  ( p,v )  are  right  eigenpairs  for  the  matrices 

Q2  and  respectively,  then  (Xp,  u  ®  v )  is  a  right  eigenpair  for  the 

matrix  Tk,k  •  The  eigenvalues  of  Tk,k  are  therefore  all  in  the  open  unit  disc,  or 
equivalently  the  eigenvalues  of  Ih2  —  Tk,k  have  strictly  positive  real  parts,  and  the 
matrix  Ih2  ~  Tk,k  is  invertible. 

The  invariant  probability  vector  tt  can  now  be  obtained  by  following  exactly 
the  same  steps  as  in  Section  III.4:  First,  rewrite  the  equation  7r  =  7 rT,  in  the  form 

tto  loo  +  7T 1  T10  =  7ro(6.3.2a) 
7T0  T01  +  TTl  ( Q2  ®  Ql  +  P2  92  ®  Pi  9l)  +  5T2  {P2  92  ®  Ql)  =  *1  (6.3.26) 
TTfc-1  (Q 2  ®>  Pi  91 )  +  Kk  ( Q2  ®  Ql  +  P2  92  ®  Pi  9l)  +  TTfc+1  (P2  92  ®  Ql)  =  Kk 

1  <  k  <  K  -  1  (6.3.2c) 
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TTK- 2  (<5 2  ®  Pi  9l)  +  ftK-1  (Q 2  ®  <5l  +  P2  92  ®  Pi  9l)  +  K K  Tk,K-  1  =  K K-l 

(6.3.2  d) 

TTjf-l  Tk-1,K  +  Tk,K  =  7Tii(6.3.2e) 
In  this  case  the  equations  corresponding  to  (3.4.10)-(3.4.13)  take  the  form 
ftk  [?2  92  0  (eri  -  Pi)  9i]  =  TTfc- 1  [(era  ~  P2)  92  ®  Pi  9i]  1  <  A:  <  K  ,  (6.3.3) 

TTl  [<52  («r2  92  ~  Ir2)  ®  Ql  +  (Ir2  “  er2  92)  ®  In] 

+7To  (ej  92  ®  Pi  9i  -  T01 )  =  Oft  (6.3.4a) 

TTfc  [Q2  (era  92  ~  Ir2)  ®  Ql  +  (Ir2  ~  er2  92)  ®  4-J 

TTfc-1  [<52  (era  92  ~  Ir2)  ®  Pi  9l]  =  Oft  1  <  k  <  K  ,  (6.3.46) 


TTfc  [<52  ®  Qi  (en  9i  -  In)  -  Ira  ®  (era  9i  -  In)]  (6.3.5) 

+  TTfc+1  [P2  92  ®  <5i  (en  9i  -  In)]  =  Oft  l  <  k  <  K  -1  , 

TTfcH  =  7Tfc  [p2  92  ®  (Ql  -  (en  -Pi)9i)3  +  7Tft_i[<52  ®  Pi  9l ]  1  <  k  <  K  ,  (6.3.6) 
Similarly  use  of  (6.3.4a)  and  (6.3.1b)  give 

7T1  N  =  7Ti  (p2  92  ®  <5i)  +  Tfo  (loi  -  ei  q2  ®  PI  9i)  (6.3.7) 


Therefore,  (6.3.7)  and  (6.3.8)  give 


7T1N  =  tv0F  (6.3.10) 

where  the  hi  x  h  matrix  F  is  defined  as 

F  :=  L  +  Tbi  -  eig2  ®  Pi  qi  .  (6.3.11) 

It  can  easily  be  seen  that  when  the  second  server  is  reliable  (6.3.11)  reduces  to 
F  =  ct2  ®  {Ir2  ~  Q 2)  as  in  Chapter  III. 

Similarly  (6.3.1a)  and  (6.3.5)  yield 

■n-kM  =  nk[Q2®Pi<li}  +  Kk+i['X2q2®{Qi-{er1-Pi)qi)}  1  <  k  <  K-l  .  (6.3.12) 
and  it  now  follows  from  (6.3.7)  and  (6.2.12)  that 

nkN  =  Xk-iM  ,  1  <k<K  .  (6.3.13) 

The  system  of  equations  (6.3.13)  can  be  solved  recursively  if  either  the  matrix 
M  or  N  is  invertible.  The  necessary  and  sufficient  conditions  for  the  invertibiltiy 
of  N  are  given  in  Lemma  2.3.16  and  Corrolary  2.3.17.  In  the  case  when  the  matrix 
N  is  invertible,  this  briefly  outlined  argument  can  be  summarized  as 

7Ti  =  7To  -F  N~l 

7Tfc  =  it k-i  M  iV-1  1  <  k  <  K  (6.3.14) 

TfC  =  TTfC-l  Tk-1,K  [Ih2  ~  Tk,k)~ 1  , 

owing  to  nonsingularity  of  the  matrix  ( Ih2  —  Tk,k )■  Therefore,  every  component 
7 r*,  1  <  k  <  K,  of  7r  can  be  written  in  terms  of  n0.  To  obtain  7To,  the  equations 
(6.3.2)  is  summed  over  1  <  k  <  K  to  yield 

K-l  K-l 

7rk  ~  Y2  nkG  +  noToi  -7Ti  (p2?2  ®  Ql) 
k= 1  k= 1  (6.3.15) 

+  Kk  Tk,K-  1  —  7TK-1  (Q 2  ®  P1Q1) 
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where  the  h  x  h  matrix  G  is  given  by 


G  ( Q2  +  P2  92)  ®  [Qi  +  Pi  9i)  5  (6.3.16) 

Equations  (6.3.14)  and  (6.3.15)  constitute  the  main  result. 

Theorem  6.3.1  :  If  the  matrix  N  is  invertible  then  the  invariant  probability  vector 
7T  =  (ttq,  . . .  5  7TR-)  has  the  following  matrix  geometric  form 

7Tk  =  7T0  s  R 1  <  k  <  K  (6.3.17a) 

ttk  =  7T0  S  Rk~2  U  ,  (6.3.176) 

where  the  vector  7Tq  satisfies  the  equations 


7Cq  Z  =  0/jj  ,  7T0v  —  1  .  (6.3.18) 


The  matrices  R,S,  U,  Z  and  the  vector  v  are  defined  through  the  equations 

R  =  M  N-1 

h  X  h  matrix, 

S  =  F  N-1 

hi  X  h  matrix, 

U  =  Tk-1,K  (Ih2  —  Tk,k)~1 

h  X  h2  matrix, 

w  =  EfJi1  -5  Rk -1 

hi  x  h  matrix, 

Y  =  SRK~2  {UTKtK-i  ~  Q2  ®Pi?i) 

hi  x  h  matrix, 

Z  =  [W  -  W  G  -  Toi  +  S  {P2  92  ®  Qi)  -  Y] 

hi  X  h  matrix, 

v  =  ehl  +  W  e^  +  S  Rk~ 2  e^2 

hi  x  1  vector, 

and  the  matrices  F  and  G  are  given  by  (6.3.11)  and  (6.3.16), 

respectively. 

Similar  calculations  can  be  carried  out  for  the  continuous-time  formulation  and 
the  analog  of  Theorem  3.6.3  would  be  obtained.  Since  in  this  case,  the  matrices 
M  and  N  are  always  nonsingular ,  no  assumptions  are  needed.  Furthermore,  the 
underlying  Markov  process  is  again  always  irreducible.  Also,  in  both  the  continuous 
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and  discrete-time  formulations,  results  similar  to  the  ones  of  Section  III. 5  can  be 
obtained  when  the  order  of  the  servers  is  reversed.  Finally,  by  using  the  results 
of  Section  2,  the  model  of  Chapter  V  can  also  be  studied  by  the  same  solution 
technique. 

Special  Case  —  When  only  operational  failures  are  allowed  : 

The  solution  for  the  case  when  idling  servers  cannot  fail  can  be  obtained  as  a 
special  case  of  the  discussion  given  above.  In  this  case,  even  if  the  servers  cannot 
fail  when  idling,  the  same  state  description  has  to  be  made  as  a  server  can  still  fail 
at  the  time  epoch  of  a  service  completion.  Therefore,  the  results  of  this  case  can  be 
obtained  by  setting  g 2  and  (f> 2  equal  to  zero  in  matrices  Too  and  Tn,  respectively, 
and  by  setting  <jq  equal  to  zero  in  matrices  Tk,k-i  and  Tk,k •  Note  that  <^2  is  set 
to  zero  only  in  T0i  since  the  second  server  is  still  allowed  to  fail  with  probability 
at  a  service  completion  epoch. 
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VI. 4  Numerical  Examples  : 


In  this  section  the  effects  of  failures  on  the  invariant  probabilities  for  the  model 
of  Chapter  III  are  illustrated  through  several  numerical  examples.  For  a  buffer  size 
of  K  =  5,  the  following  three  situations  are  considered: 

(i)  The  case  when  both  servers  are  reliable  and  have  Negative  Binomial  service  time 

distributions  with  PH-representations  i  =  1,2. 

(ii)  The  case  when  both  servers  are  subject  to  failures  and  have  service  distributions 
as  in  (i),  and  the  first  server  has  a  geometric  down  time  distribution  with  coefficient 
0.8,  while  the  second  server  has  hypergeometric  down  time  distribution  with  PH- 
representation  (/?2 ,82)-  In  this  case  the  idling  servers  are  allowed  to  fail  with 
probabilities  gi  =  0.01  and  <72  =  0.5. 

(iii)  In  this  case  both  servers  are  subject  to  failures  and  have  service  and  repair 
distributions  as  in  (ii) ,  but  idling  servers  are  not  allowed  to  fail. 

The  following  numerical  values  are  considered. 


.  _  /  0.8  0.2  \  _  H  nA 
Al  ~  \  0  0.3 )  ’  ai  “  t1’0)  ’ 

.  /0.6  0.4  \  _  .. 

A2  \  0  0.5 )  ’  a2  (1)0)  ’ 

ft  =  (0.4,0.6), 


The  matrices  A /i5  Ci  and  Di,  i  =,1,2,  are  given  by 


= 


? 


and 


Ci 


C2  =  e2  /?2  , 


D 1  =  «i  ,  D 2  —  e2  0:2  , 


5 
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while  the  probabilities  of  a  failure  at  a  service  completion  are  <f>i  =  0.2  and  <j> 2  =  0.3. 
Therefore  the  effective  service  time  representations  (qi,Qi),  i  =  1,2,  are  given  by 


f  0.72  0.18 
Qi  =  0  0.27 

\  0.8  0 


/  0.48 

0.32 

0.08 

0.12 

>  Q2  — 

0 

0.4 

0.08 

0.12 

0.5 

0 

0.5 

0 

V  0.4 

0 

0 

0.6 

5 


and 

qi  =  (0.8, 0,0.2)  ,  q2  =  (0.7,0,0.12,0.18)  . 

If  the  random  variables  Si,  R{  and  S i  =  1,2,  denote  the  service  time, 
repair  time  and  the  effective  service  time  of  server  i  =  1,2,  respectively,  then  the 
above  numerical  values  lead  to  following  expected  values:  =  7,  E[S2]  = 

4,  E[Rx}  =  1.25,  E[R2]  =  2.3,  E[S{ff }  =  9.28,  and  E[Se2ff }  =  11.18.  Note  that 
although  E[Si  +  Ri]  >  E[S2  +  R2\  the  average  effective  service  time  of  the  second 
server  is  greater  then  the  average  effective  service  time  of  the  first  server  since  the 
second  server  is  more  likely  to  breakdown.  The  effect  of  breakdowns  can  easily  be 
seen  from  the  queue  size  probabilities  in  Table  6.4.1.  As  expected,  in  the  first  case, 
there  are  less  then  three  jobs  in  the  buffer  for  most  of  the  time  whereas  in  cases 
II  and  III  there  are  more  then  three  jobs  in  the  buffer  for  most  of  the  time.  On 
the  other  hand  the  probabilities  in  cases  II  and  III  differ  only  slightly  although  the 
second  server  has  a  high  probability  of  failure  when  it  is  idle.  The  reason  for  this 
is  that  the  second  server  is  idle  with  a  very  low  probability  and  the  probability  of 
a  failure  when  the  first  server  is  idle  is  very  low.  The  invariant  probability  vectors 
obtained  by  using  Theorem  6.3.1  are  given  in  Table  6.4.2. 
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Steady  state  queue  size  probabilities 


Queue  size 

Case  1 

Case  2 

Case  3 

0 

0.3042 

0.0619 

0.0672 

1 

0.3950 

0.1131 

0.1143 

2 

0.1904 

0.1495 

0.1483 

3 

0.0758 

0.1952 

0.1936 

4 

0.0286 

0.2512 

0.2492 

5 

0.0059 

0.2290 

0.2275 

Table  6.4.1 


-  102  - 


Case  1 


7T0  =(0.2181,0.0861) 

7 n  =(0.2045,0.0433,0.1090,0.0382) 
tt2  =(0.0736,0.0163,0.0817,0.0188) 
tt3  =(0.0283,0.0063,0.0337,0.0075) 
tt4  =(0.0110,0.0016,0.0132,0.0028) 
tt5  =(0.0017,0.0042) 

Case  2 

7T0  =(0.0207,0.0061,0.0040,0.0075,0.0022,0.0014,0.0134,0.0040,0.0026) 

7T!  =(0.0350,0.0087,0.0068,0.0151,0.0043,0.0028,0.0098,0.0025,0.0019,0.0181,0.0046,0.0035) 
7t2  =(0.0441,0.0113,0.0086,0.0225,0.0058,0.0044,0.0128,0.0033,0.0025,0.0237,0.0061,0.0046) 
7t3  =(0.0576,0.0147,0.0112,0.0294,0.0075,0.0057,0.0167,0.0043,0.0032,0.0309,0.0079,0.0060) 
tt4  =(0.0788,0.0155,0.0122,0.0386,0.0097,0.0073,0.0225,0.0049,0.0038,0.0414,0.0093,0.0072) 
tt5  (0.0876,0.0561,0.0286,0.0567) 

Case  3 

7T0  =(0.0418,0.0124,0.0080,0.0012,0.0004,0.0002,0.0022,0.0006,0.0004) 

TTi  =(0.0380,0.0087,0.0076,0.0164,0.0046,0.0031,0.0088,0.0025,0.0017,0.0157,0.0044,0.0030) 
tt2  =(0.0437,0.0112,0.0085,0.0224,0.0057,0.0044,0.0127,0.0032,0.0025,0.0234,0.0060,0.0045) 
7t3  =(0.0571,0.0146,0.0111,0.0292,0.0075,0.0057,0.0166,0.0042,0.0032,0.0307,0.0078,0.0060) 
tt4  =(0.0783,0.0154,0.0119,0.0383,0.0096,0.0072,0.0223,0.0049,0.0037,0.0411,0.0093,0.0071) 
tt5  =(0.0871,0.0557,0.0285,0.0563) 

Table  6.4.2 
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CHAPTER  VII 


AN  APPROXIMATION  METHOD  FOR  GENERAL  TANDEM 
QUEUEING  SYSTEMS  SUBJECT  TO  BLOCKING 

VII. 1.  Introduction  : 

In  this  chapter  an  iterative  approximation  scheme  is  presented  for  finding  the 
steady-state  marginal  probabilities  of  the  queue  sizes  in  general  tandem  queueing 
systems  with  finite  capacity  intermediate  buffers  and  PH-type  servers  under  the 
assumption  that  the  steady-state  exists.  The  algorithm  is  based  on  the  analytical 
results  obtained  for  two  node  systems  and  is  presented  under  the  immediate  blocking 
policy.  Effective  two  node  representations  of  each  buffer  is  first  obtained  and  then 
approximations  are  made  in  order  to  express  the  effective  representations  recursively 
in  terms  of  the  quantities  that  can  be  obtained  from  the  two  node  model.  In 
Section  3,  the  accuracy  of  the  algorithm  is  validated  through  numerical  examples, 
both  for  continuous  and  discrete-time  systems.  The  same  approximation  scheme 
also  applies  to  tandem  systems  under  nonimmediate  blocking  policy  in  view  of  the 
equivalence  discussed  for  two  node  systems  in  Chapter  I.  Although  no  theoretical 
basis  is  provided  for  this  case,  comparison  of  the  results  against  simulations  indicates 
reasonable  accuracy  under  both  blocking  policies  even  in  the  presence  of  significant 
blocking.  In  view  of  the  results  derived  in  Chapter  VI,  the  approximation  scheme  is 
also  applicable  to  failure  type  servers  with  PH-type  service  and  repair  distributions. 

The  algorithm  uses  the  decomposition  technique  that  has  been  used  in  many 
of  the  approximation  algorithms.  All  the  approximation  algorithms  known  to  date 
considers  tandem  lines  with  exponential  servers,  possibly  subject  to  failures  with 
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exponential  down  time  distributions.  The  present  algorithm  generalizes  these  algo¬ 
rithms  to  tandem  lines  where  failure  type  servers  with  PH-type  up  and  down  time 
distributions  are  in  attendance. 

Most  approximation  algorithms  use  the  flow  conservation  principle  to  decom¬ 
pose  the  tandem  model  into  simple  two  node  models.  The  approximation  reported 
here  uses  the  approach  taken  in  Altiok  [l],  and  represents  the  effective  service  dis¬ 
tribution  of  a  server  by  considering  all  the  servers  upstream  of  this  server  so  as 
to  capture  the  effect  of  blocking.  The  algorithm  presented  here  differs  from  the 
method  in  [l]  in  that  a  similar  effective  representation  is  also  considered  in  order  to 
capture  the  effect  of  idling.  Whereas  in  [l],  the  system  is  decomposed  into  several 
Mj PH/l/ K  queueing  systems  by  approximating  the  arrivals  to  the  ith  buffer  by  a 
Poission  process  in  view  of  the  flow  conservation  principle.  Once  the  decomposition 
is  done,  the  iterative  solution  technique  presented  here  uses  a  similar  method  to  the 
one  given  by  Bradwajn  and  Jow  [13],  where  exponential  servers  with  state  depen¬ 
dent  service  rates  and  only  immediate  neighbors  are  considered  in  decomposing  the 
tandem  line. 
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VII. 2.  Decomposition  and  Approximation  Method  : 


Consider  a  tandem  system  as  shown  if  Figure  7.2.1.  There  are  N  PH-type 
servers  in  tandem  with  N  —  1  intermediate  buffers  with  capacities  K{,  1  <  i  <  N, 
with  the  assumption  that  the  last  server  is  never  blocked  and  the  first  server  is  always 
busy,  i.  e.,  infinite  supply  of  exogenous  jobs.  The  servers  have  PH-representations 
where  cti  and  Qi  are  lxm;  and  mi  x  mt-  matrices,  respectively,  and  m,-  is 
the  number  of  phases  in  the  service  distribution  of  the  ith  server,  1  <  i  <  N.  The 
mi  X  1  column  vectors  of  absorption  probabilities  are  denoted  by  pi,  1  <  i  <  N. 


0  K  i  (g)— >  K2  (g) 


Kn- 2  |0  — ►  Kn- i  0 


Figure  7.2.1 

The  steady  state  marginal  probabilities  for  the  queue  sizes  in  the  ith  queue 
could  be  calculated  from  the  results  of  Chapter  III  if  the  (i  +  l)st  server  were  not 
subject  to  blocking  and  the  ith  server  were  always  busy.  However,  at  a  service 
completion  epoch  at  the  (i  +  l)st  server,  this  server  may  be  blocked  and  remain 
blocked  until  there  is  a  departure  from  the  (i  +  l)s<  queue.  Similarly,  at  a  service 
completion  at  the  ith  server,  this  server  may  become  idle. 

In  order  to  discuss  the  blocking  and  idling  of  the  ith  server  the  following  events 
are  defined  for  1  <  i,j  <  N  and  t  >  0. 

Bl{t)  :  ith  server  is  blocked  at  time  t, 

:  jth  server  is  not  blocked  and  in  phase  of  service  l  at  time  t,  and  that 
all  the  servers  k,  i  <  k  <  j  are  blocked, 

P(t)  :  ith  server  is  idle  at  time  t. 


-  106  - 


A/'  •  , 

I]'3  {t)  :  jth  server  is  not  idle  and  in  service  phase  l  at  time  f,  and  that 
all  the  servers  k,  j  <  k  <  i  are  idle. 

Assuming  that  the  limits  exists  the  following  probabilities  can  now  be  defined: 

P'b  :=  lim  P[Pl'(r‘)]  ,  1  <  i  <  N 

refoo 

PlJ  :=  lim  P[P|-y(T*)]  ,  1  <i<j<N 

Bi  nfoo 

Pj  :=  lim  P[P(T*)]  ,  1  <  i  <  N 

nfoo 

py  :=  lim  P[PJ(T;)]  ,  1  <j<i<N 

Ii  nfoo 

where  is  the  nth  service  completion  time  at  node  i,  for  n  =  0, 1, . . ..  Note  that, 
due  to  the  assumption  that  the  first  server  is  never  starved  and  that  the  last  server 
is  never  blocked,  some  of  the  above  defined  probabilities  are  either  0  or  1  for  some 
values  of  i  and  j. 

Decomposition:  In  order  to  capture  the  effect  of  blocking  in  the  (&‘+l)st  server,  the 
effective  service  time  distribution  of  this  server  is  represented  by  a  PH-distribution 
with  (TOt+i  +  ...  +  mjv)  phases  obtained  by  considering  the  service  distributions 
of  all  the  servers  downstream  from  the  (i  +  l)s<  server.  Upon  the  nth  service 
completion  in  the  (i  +  l)th  server,  this  server  is  either  blocked  with  probability 
P[Bl+1(T^+1)}  or  starts  serving  its  next  job  (if  any)  according  to  the  initialization 
vector  ai+ In  the  case  of  blocking,  say  the  event  B|+1,,'(T£+1)  took  place  for 
some  j,  i  +  1  <  j  <  N,  and  /,  1  <  l  <  rrij ,  the  effective  service  time  of  the 
i  +  1st  server  will  be  equal  to  the  residual  service  time  in  the  jth  server  plus  sum 
of  the  service  times  of  all  the  blocked  servers  j  —  1, ...,?  +  2  (time  to  unblock), 
plus  the  service  time  in  the  i  +  1st  server.  Therefore,  if  at  time  T£+1  the  i  +  1st 
server  is  blocked  the  effective  service  phase  of  the  (*  +  l)*71  server  is  reinitialized  at 
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phase  l  of  the  jth  server  with  probability  P[B[+1,;?  (T*+1)]  and  the  transitions  among 
these  phases  occur  according  to  the  matrix  Qj.  Upon  service  completion  in  the  jth 
server,  service  in  the  (j  -  l)s*  server  is  initialized  according  to  aj-i,  thus  causing  a 
transition  from  the  phases  corresponding  to  jth  server  to  phases  corresponding  to 
the  (j  -  l)3t  server  in  the  effective  representation  of  the  (*'  +  l)*fe  server.  Finally, 
upon  service  completion  in  the  (t  +  2)nd  server  blocking  period  of  the  (i  +  l)3t 
server  will  end  and  this  server  will  resume  its  service  according  to  the  initialization 
vector  <*,-+!.  Therefore,  if  the  (mt+1  +  ...  +  mjv)  X  (mt+i  +  ...  +  mN )  matrix 
Q2  (*  +  1)  denotes  the  one-step  probability  transition  matrix  among  the  transient 
phases  of  the  effective  representation  of  the  (i  +  l)st  server  and  if  the  corresponding 
(mj+i  +  . . .  +  mjv)  x  1  column  vector  of  absorption  probabilities  from  the  effective 
service  phases  is  denoted  by  p2{i  +  1),  then 


Q2(*  +  1)  = 

/  Qi+ 1 

Pi+2  «i+l  Qi+2 

\ 

,  P2&+  1)  = 

f  Pi+1  \ 

c*. 

V 

PN  OiN-l  Qn-3 

7 

1  <  »  <  N  ,  (7.2.1) 

and  the  1  x  (m^+i  +  . . .  +  mx)  initialization  probability  vector  a2(i  +  l)  of  the 
effective  representation  of  the  (i  +  1)3<  server  is  given  by 


«»(<  + 1)  ==  (pTo^i+uPi+l■<+2,...,Pi+l^,,) 


(7.2.2) 


for  1  <  i  <  N,  and  the  1  x  my  row  vector  has  entries  Plf1’3,  1  <1  <  rru 

B  Bi  3 

With  this  effective  PH-representation  the  (*  +  l)a<  server  is  never  blocked,  but  a 
service  completion  is  allowed  only  from  the  phases  that  correspond  to  a  service  in  the 
(a+l)st  server.  The  subscript  2  indicates  that  the  representation  (a2 (*+l),  <52(*+l)) 
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is  the  effective  representation  for  the  second  node  server  when  considering  the  ith 
buffer. 

Similarly  the  effective  service  of  the  ith  server  can  be  represented  by  a  PH- 
distribution  with  (mi  +  . . .  +  mt)  phases.  A  similar  argument  reveals  that  the 
effective  representation  (o£i(t),Qi(i))  of  the  ith  server  as  the  first  node  server  in  the 
two  node  equivalent  representation  of  the  ith  buffer  is  given  by 


Qi(i)  = 

(  Qi  \ 

Pi— 1  &i  Qi—  1 

,  pi  (0  = 

o 

•  • 

_ s 

V  Pi  ax  QiJ 

\  of  J 

,  1  <  i  <  N  , 


(7.2.3) 

where  pi  (*)  is  the  (mi  + . . .  +  m;)  x  1  column  vector  of  absorption  probabilities  and 

:=  Fi‘-' . Pi1)  (7.2.4) 

for  1  <  i  <  N.  and  the  1  x  my  row  vector  has  entries  ,  1  <  l  <  m,- . 

Therefore,  for  each  queue  i,  1  <  i  <  N,  by  considering  the  effective  represen¬ 
tations  (7.2.1)-(7.2.4),  the  tandem  system  in  Figure  7.2.1  can  be  decomposed  into 
N  —  1  two  node  systems  of  the  type  studied  in  Chapterlll.  More  preciesly  the  two 
node  equivalent  of  buffer  i  is  as  given  in  Figure  7.2.2. 


(«i(*'),Qi(0) 


(«2(*  4- 1),  Q2  (*'  +  1)) 


Figure  7.2.2 

Let  the  1  x  (mi  +  . . .  +  mt)  and  1  X  (ml+i  +  . . .  +  m at)  row  vectors  7To(f)  and 
7 rjr(i)  be  the  steady  state  probability  vectors  that  the  ith  buffer  is  empty  and  full, 
respectively,  obtained  from  the  two  node  equivalent  representation  in  Figure  7.2.2. 
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If  k  =  mt+ 1  +  . . .  +  m,i+j  +  l  for  1  <  j  <  N  —  i  and  1  <  l  <  m;+y+1,  then  the 
kth  component  of  the  vector  7fp(i)  is  the  steady  state  probability  that  the  servers 
i,  i  +  1,. . .  ,t  +  j  are  all  blocked  and  the  (t  +  j  +  l)st  server  is  in  its  Ith  phase  of 
service.  Similarly,  if  k  —  +  +  . .  .  +  rrii-j+l ,  0  <  j  <  i  —  1,  1  <  /  <  mt_y_ i, 

then  the  kth  component  of  the  vector  7To(0  *s  steady  state  probability  that  the 
buffers  i,  i  —  1, . . . ,  i  —  j  are  all  empty  and  the  (i  —  j  —  l)ih  server  is  in  its  Ith  phase 
of  service. 

Approximation  :  In  order  to  put  the  equivalent  model  into  the  framework  of 
Chapter  III,  the  following  approximations  are  made: 


Pi  «  lim  PlBUt)]  ,  1  <i<N 

t  too 

py  «  lim  ,  1  <  *  <  j  <  N 

Bi  floo 


Pj  »  lim  P[P{t)}  ,  1  <i<N 

°° 

py  «  lim  P[lj'j{t)}  ,  1  <j<i<N 

Ii  i|  oo 


(7.2.5) 


In  view  of  (7.2.5)  and  the  above  descriptions  of  the  vectors  7To(i)  and  ftp (i) ,  the 
initialization  vectors  ai(i)  and  a.2  (i  +  2)  in  the  effective  two  node  representation  of 
Figure  7.2.2  are  approximated  by  a“(i)  and  +  1),  respectively,  given  by 

ai(0  :=  [  (1  —  Po(*  ~  1) )  cci,n0(i  -  1)]  ,  (7.2.6a) 

aa2{i  +  1)  :=  [  (1  -  PF{i  +  1) )  ai+l,pF{i  +  1)]  .  (7.2.66) 

where  the  scalars  Pp  (f)  and  Po{i)  satisfy 

PF(i)  =  nF(i)  er(j)  ,  P0(«)  =  7 r0(t)  es(t)  ,  l<i  <N 

with  r(i)  =  m,-+i  +  . . .  +  mpr  and  s(i)  —  m i  +  . . .  +  m;. 
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This  approximation  leads  to  an  iterative  approach  based  on  the  two  node  anal¬ 
ysis.  The  marginal  probability  distribution  of  the  queue  sizes  at  queue  i  can  be 
obtained  once  the  vectors  iro(i  —  1)  and  7Vp(i  +  1)  are  known.  These  vectors  are 
calculated  from  the  two  node  approximations  of  the  (i  —  l)s*  and  (t  +  l)st  queues, 
respectively,  during  the  past  iteration  step.  More  precisely,  the  steps  of  the  iterative 
procedure,  by  abusing  the  notation  and  using  a  superscript  to  denote  the  iteration 
number,  are  : 

1.  Select  an  initial  approximation  for  the  vectors  2  <  i  <  N . 

2.  At  iteration  n,  starting  from  the  first  queue,  solves  the  effective  two  node 
systems  of  the  form  in  Figure  7.2.2  for  each  buffer  using  tvq  (£— 1)  and  (*-fl) 
at  queue  i,  for  2  <  i  <  N  —  2,  and  by  using  a"  (i)  =  ai  at  buffer  1  and 
Q!2_1(iV  —  1)  =  ajv  at  buffer  N  —  1.  The  solution  for  the  ith  queue  will  yield 
7Tq(0  and  ftp  (*) . 

3.  Test  for  a  convergence  criterion,  if  not  satisfied  set  n  to  n  +  1  and  go  to  step  2. 

Although  there  is  no  proof  of  convergence,  the  algorithm  has  always  converged, 
up  to  10-4,  in  less  then  10  iterations  in  many  examples.  Since  at  each  node  all  the 
servers  are  taken  into  account,  the  computational  complexity  of  the  algorithm  grows 
quadratically  with  the  number  of  servers  in  tandem.  However,  this  growth  can  be 
made  linear  by  considering  only  a  few  immediate  neighboring  servers  in  the  effective 
representations.  On  the  other  hand,  the  algorithm  can  be  made  much  faster  as  it  is 
very  suitable  for  parallel  computation.  At  each  node  the  effective  representations 
Qi(t)  and  Q 2(*),  1  <  *  <  N,  are  fixed,  therefore  a  different  processor  can  be 
assigned  to  each  node,  this  processor  needs  information  only  from  its  immediate 
neighbors,  namely  from  processors  i  +  1  and  i  —  1. 
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VII. 3.  Numerical  Examples  : 

The  accuracy  of  the  algorithm  is  tested  against  simulations  with  both  relative 
and  absolute  errors  in  the  approximations  being  listed.  Although  relative  errors 
are  usually  a  more  important  measure  of  accuracy  of  an  approximation  scheme, 
when  determining  the  relative  or  absolute  errors  made  when  calculating  some  of 
the  performance  measures  of  interest,  absolute  errors  play  a  more  important  role. 
To  illustrate  this  point,  average  queue  sizes  at  each  buffer  location  are  calculated. 
Both  the  relative  and  the  absolute  errors  for  this  performance  measure  are  better 
predicted  by  the  absolute  errors  in  the  calculation  of  the  probabilities.  For  instance, 
in  example  3,  in  the  approximation  of  the  probability  of  having  an  empty  buffer 
at  the  second  queue  20%  relative  error  is  made,  while  the  absolute  error  is  only 
2.3%.  The  relative  error  in  the  average  queue  size  for  this  buffer  is  only  3.9%.  In 
many  cases  the  algorithm  approximates  the  probabilities  up  to  the  third  digit  after 
the  decimal  point,  but  the  relative  error  may  be  high  when  the  true  value  of  the 
probabilities  are  very  small.  Such  an  accuracy  is  generally  considered  reasonable 
since  due  to  blocking  it  usually  takes  a  long  time  for  the  system  to  reach  steady 
state.  Therefore,  the  simulations  are  believed  to  be  accurate  only  up  to  the  third 
digit  after  the  decimal  point. 

The  first  four  examples  are  for  the  discrete  time  model  under  immediate  blocking 
strategy  and  involves  only  geometric  servers.  Examples  1  and  2  have  the  same 
parameters  except  the  buffer  capacities.  The  approximation  gives  better  results  in 
example  2  since  it  has  smaller  Po(0  and  Pjr(f),  1  <  i  <  N.  The  examples  indicate 
that  the  reversibility  property  discussed  in  Section  3.5  seem  to  hold  for  a  general 
tandem  line  under  immediate  blocking  strategy.  In  examples  1  and  2  since  the 
tandem  line  is  totally  symmetric  reversing  the  order  of  the  servers  yield  the  exact 
same  probabilities.  Example  4  is  the  same  as  example  3  except  that  the  order  of  the 
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servers  and  the  intermediate  buffers  are  reversed.  The  approximation  scheme  yields 
totaly  symmetric  probabilities.  In  the  simulations  the  corresponding  probabilities 
change  in  the  third  digit  after  the  decimal  point,  which  is  believed  to  be  the  margin 
of  inaccuracy  in  the  simulations. 


Example  1  :  N  =  4,  K{  —  2,  i  —  1,2,3.  Immediate  blocking. 
Geometric  servers;  pi  =  0.5,  i  =  1,2, 3, 4. 


Buffer 

Queue  Size 

Exact  Sol’n. 

Rel. Error 

Abs. Error 

1 

0 

0.1738 

0.1652 

-0.0521 

-0.0086 

1 

0.4641 

0.4596 

-0.0098 

-0.0045 

2 

0.3621 

0.3754 

0.0354 

0.0133 

Average  queue  length: 

1.1183 

1.2104 

0.0183 

0.0221 

2 

0 

0.2629 

0.2621 

-0.0031 

-0.0008 

1 

0.4742 

0.4757 

0.0032 

0.0015 

2 

0.2629 

0.2621 

-0.0031 

-0.0008 

Average  queue  length: 

1.0000 

0.9999 

-0.0001 

-0.0001 

3 

0 

0.3621 

0.3754 

0.0354 

0.0133 

1 

0.4641 

0.4596 

-0.0098 

-0.0045 

2 

0.1738 

0.1652 

-0.0521 

-0.0086 

Average  queue  length: 

0.8117 

0.7900 

-0.0275 

-0.0217 

Table  7.3.1 
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Example  2  :  N  =  4,  Ki  —  4,  i  —  1,2,3.  Immediate  blocking. 


Geometric 

servers;  pi 

II 

o 

b» 

5->  . 

II 

l—i 

to 

CO 

4. 

Buffer 

Queue  Size 

Approx. 

Simulation 

Rel. Error 

Abs. Error 

1 

0 

0.081 

0.079 

0.025 

0.002 

1 

0.184 

0.186 

0.011 

0.002 

2 

0.238 

0.235 

-0.013 

-0.003 

3 

0.305 

0.305 

0.000 

0.000 

4 

0.193 

0.185 

-0.043 

-0.008 

Average  queue  length: 

2.347 

2.311 

-0.016 

-0.036 

2 

0 

0.130 

0.127 

-0.024 

-0.003 

1 

0.246 

0.247 

0.004 

0.001 

2 

0.247 

0.247 

0.000 

0.000 

3 

0.246 

0.249 

0.012 

0.003 

4 

0.130 

0.130 

0.000 

0.000 

Average  queue  length: 

1.998 

2.008 

0.005 

0.010 

3 

0 

0.193 

0.195 

0.010 

0.002 

1 

0.305 

0.308 

0.010 

0.003 

2 

0.238 

0.238 

0.000 

0.000 

3 

0.184 

0.182 

-0.011 

-0.002 

4 

0.081 

0.076 

-0.066 

-0.005 

Average  queue  length: 

1.657 

1.634 

-0.014 

-0.023 

Table  7.3.2 
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Example  3  :  N  =  5,  K\  —  K3  =  2,  K 2  =  X4  =  3.  Immediate  blocking. 

Geometric  servers;  pi  =0.7,  P2  =  0.8,  ps  =  0.9,  p4  =  0.75,  p5  =  0.6. 


Buffer  Queue  Size 

Approx. 

Simulation 

Rel. Error 

Abs.  Error 

1  0 

0.169 

0.176 

0.040 

0.007 

1 

0.601 

0.601 

0.000 

0.000 

2 

0.230 

0.223 

0.031 

0.007 

Average  queue  length: 

1.061 

1.047 

-0.013 

-0.014 

2  0 

0.095 

0.118 

0.195 

0.023 

1 

0.322 

0.334 

0.036 

0.012 

2 

0.408 

0.377 

-0.082 

-0.031 

3 

0.175 

0.171 

-0.023 

-0.004 

Average  queue  length: 

1.663 

1.601 

-0.039 

-0.062 

3  0 

0.092 

0.103 

0.107 

0.011 

1 

0.592 

0.589 

-0.005 

-0.003 

2 

0.316 

0.308 

-0.026 

-0.008 

Average  queue  length: 

1.224 

1.205 

-0.016 

-0.019 

4  0 

0.080 

0.091 

0.121 

0.011 

1 

0.297 

0.305 

0.026 

0.008 

2 

0.428 

0.416 

-0.029 

-0.012 

3 

0.195 

0.188 

-0.037 

-0.007 

Average  queue  length: 

1.738 

1.701 

-0.022 

-0.037 

Table  7.3.3 
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Example  4  :  N  =  5,  K\  =  K3  =  3,  K 2  =  K4  =  2.  Immediate  blocking. 

Geometric  servers;  pi=0.6,  p2  =  0-75,  p3  =  0.9,  p4  =  0.8,  p5  =  0.7. 


Buffer  Queue  Size 

Approx. 

Simulation 

Rel.Error 

Abs. Error 

1  0 

0.195 

0.191 

-0.021 

-0.004 

1 

0.428 

0.413 

-0.036 

-0.015 

2 

0.297 

0.303 

0.020 

0.006 

3 

0.080 

0.093 

0.140 

0.013 

Average  queue  length: 

1.262 

1.298 

0.028 

0.036 

2  0 

0.316 

0.308 

-0.025 

-0.008 

1 

0.592 

0.589 

-0.005 

-0.003 

2 

0.092 

0.103 

0.107 

0.011 

Average  queue  length: 

0.795 

0.776 

0.024 

0.019 

3  0 

0.175 

0.172 

-0.017 

-0.003 

1 

0.408 

0.376 

-0.085 

-0.032 

2 

0.322 

0.333 

0.033 

0.011 

3 

0.095 

0.119 

0.202 

0.024 

Average  queue  length: 

1.399 

1.337 

0.044 

0.062 

4  0 

0.230 

0.224 

-0.027 

-0.006 

1 

0.601 

0.604 

0.005 

0.003 

2 

0.169 

0.172 

0.017 

0.003 

Average  queue  length: 

0.948 

0.939 

0.009 

0.009 

Table  7.3.4 
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The  next  example  is  intended  to  give  some  ideas  of  the  accuracy  of  the  algo¬ 
rithm  developed  in  Section  2  under  immediate  blocking  policy  to  tandem  lines  that 
operate  under  the  nonimmediate  blocking  policy.  The  invariant  probability  vector 
for  the  model  of  Chapter  III,  with  intermediate  buffer  capacity  K ,  under  nonim¬ 
mediate  blocking  policy  can  also  be  obtained  from  Theorem  3.3.7  by  considering 
the  service  location  of  the  first  node  server  as  part  of  the  intermediate  buffer,  thus 
incrementing  the  effective  intermediate  buffer  capacity  from  K  to  K  +  1.  After  the 
invariant  probability  vector  -k  =  (710, . . . ,  kkiKk+i)  is  obtained  in  matrix-geometric 
form,  as  given  by  Theorem  3.3.7,  the  probability  of  having  a  full  buffer  is  given  by 
^K^ml  +  ^K+ieli  where  m  and  l  are  the  number  of  phases  in  the  PH-representations 
of  the  first  and  the  second  node  servers,  respectively. 

As  an  example,  a  tandem  line  with  three  servers  is  considered.  The  first  and 
the  third  node  servers  have  generalized  Erlang  service  distributions  whereas  the 
second  node  server  has  hyperexponential  service  distribution,  all  with  two  phases. 
The  following  numerical  values  are  considered: 

Qi  =  (”q2  J?2)  ,  «!  =  (1,0),  ES\  =  1.5  , 

Q2(~0  -O.5)’  «2  =  (0.3,0.7)  ,  ES2  =  1.7  , 

33=(-2'5  =  (1,0),  £53  =  1.4, 

where  ESi  is  the  corresponding  expected  service  time  of  server  i,  1  <  *  <  3.  The 
results  are  summarized  in  Table  7.3.5.  Four  independent  simulation  runs  are  per¬ 
formed  on  the  Performance  Analysis  Workstation  (PAW)  where  the  results  obtained 
from  each  simulation  were  within  0.01  of  each  other.  The  resulsts  listed  in  the  sim¬ 
ulation  column  in  Table  7.3.5  are  the  arithmetic  average  of  these  four  simulation 
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runs.  The  approximation  algorithm  converged  up  to  10-4  in  5  iterations  and  the 
results  are  mostly  within  the  accuracy  range  of  the  simulations. 

Example  5  :  N  =  3,  K\  —  2,  K%  —  3.  Nonimmediate  blocking. 


Buffer 

Queue  Size 

Approx. 

Simulation 

1 

0 

0.167 

0.157 

1 

0.246 

0.248 

2 

0.587 

0.597 

2 

0 

0.316 

0.350 

1 

0.268 

0.288 

2 

0.196 

0.194 

3 

0.220 

0.168 

Table  7.3.5 
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FUTURE  DIRECTIONS 


Throughout  the  thesis,  long-run  average  results  have  been  sought  by  assuming 
that  the  system  will  reach  equilibrium  fairly  rapidly.  However,  in  an  actual  produc¬ 
tion  line,  the  system  being  subject  to  blocking  and  occasional  failures,  equilibrium 
may  be  achieved  very  slowly.  Therefore,  designs  based  on  equilibrium  calculations 
may  not  be  adequate  and  a  better  understanding  of  the  transient  behavior  of  the 
system  may  be  needed.  It  is  thus  of  interest  to  study  the  transient  behavior  of  the 
underlying  Markov  chain  so  as  to  get  precise  information  on  the  rate  at  which  the 
equilibrium  is  achieved  and  to  understand  how  the  transient  performance  measures 
behave. 

Also,  efforts  should  be  made  for  better  understanding  of  the  approximation 
scheme  presented  in  Chapter  7,  as  well  as  for  developing  new  algorithmic  method¬ 
ologies  to  compute  the  quantities  of  interest.  In  particular,  questions  of  convergence 
and  in  the  event  of  convergence  the  rate  of  convergence  and  the  possible  limit  points 
should  be  studied.  Also  as  remarked  in  Chapter  7,  parallel  implementation  of  the 
algorithm  should  be  explored. 
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APPENDIX 


Annotated  bibliography  of  blocking  systems 

Queueing  systems  subject  to  blocking  have  been  studied  by  reaserchers  from 
different  research  communities.  Due  to  the  wide  applicability  of  these  models  there 
is  an  exhaustive  list  of  related  papers.  The  survey  given  here  combines  a  portion  of 
such  papers.  The  rest  of  the  papers,  to  the  knowledge  of  the  author,  are  included 
in  the  references. 

The  papers  reviewed  here  are  classified  into  two  major  classes  depending  on 
whether  the  servers  are  reliable  or  subject  to  breakdowns,  and  the  papers  in  each 
class  are  presented  in  historical  order  as  they  appeared  in  the  literature.  A  common 
assumption  to  all  the  models  surveyed  is  that  the  last  stage  is  never  blocked,  i.e., 
there  is  always  space  available  into  which  the  last  stage  server(s)  can  discharge  a 
part.  Also,  as  it  is  usually  the  case  in  many  models,  unless  otherwise  specified  the 
stages  have  single  servers. 


-  120  - 


MODELS  WITH  RELIABLE  SERVERS 


[1]  G.C.  Hunt,  “  Sequential  arrays  of  waiting  lines,”  Operations  Res.,  4,  pp.  674-683, 
(1956). 

Model:  A  tandem  line  of  exponential  servers  with  Poisson  arrivals  to  an  infinite 
buffer  in  front  of  the  first  server  is  considered.  Four  different  models  are  discussed 
under  non-immediate  blocking  assumption.  The  models  involve;  (i)  infinite  capacity 
buffers  between  the  servers,  (ii)  no  buffers  between  the  servers,  (iii)  finite  capacity 
buffers  between  the  servers,  and  (iv)  a  line  of  M  servers  where  the  line  moves  at 
once  as  a  unit  (the  unpaced  belt  production  line)  where  no  buffers  and  no  vacant 
servers  are  allowed. 

Measure:  Mean  number  of  jobs  in  the  system  and  maximum  utilization  is  consid¬ 
ered. 

Results:  Maximum  possible  utilization  is  obtained  in  all  cases  and  graphs  of  uti¬ 
lization  vs.  mean  number  of  jobs  in  the  system  are  displayed.  It  is  reported  that 
when  utilization  is  less  than  0.5  blocking  has  almost  no  effect. 

[2]  H.S.  Hillier  and  R.W.  Boling,  “  Finite  queues  in  series  with  exponential  or  Erlang 
service  times  -  A  numerical  approach,”  Operations  Res.,  15,  pp.  286-303,  (1967). 

Model:  A  tandem  line  of  servers  with  exponential  or  Erlang  service  distributions 
seperated  by  finite  capacity  buffers  is  considered.  Non-immediate  blocking  is  as¬ 
sumed  with  infinite  supply  of  job  units  in  front  of  the  first  server. 

Measures:  Steady-state  output  rate  and  mean  number  of  customers  in  the  system 
are  considered. 

Method:  When  the  service  times  have  Erlang  distribution  the  states  are  identi¬ 
fied  and  the  balance  equations  are  solved  numerically  using  Gauss-Seidel  method. 
For  exponential  service  times  an  approximate  procedure  which  analyzes  each  stage 
individually  as  an  M/M/l/N  queueing  system  is  given. 
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[3]  N.P.  Rao,  “  Two-stage  production  systems  with  intermediate  storage,”  AIEE 
Trans.,  7,  pp.  414-421,  (1975b). 

Model:  A  two  server  tandem  system  with  a  finite  capacity  intermediate  buffer  is 
discussed.  Service  times  are  assumed  independent  and  are  exponentially  distributed 
for  the  first  server  and  have  a  general  distribution  for  the  second.  Non-immediate 
blocking  is  assumed  with  infinite  supply  of  job  units  in  front  of  the  first  server. 
Measures:  Steady-state  probabilities  and  the  effect  of  unblancing  is  considered. 
Results:  The  equations  for  the  steady-state  probabilities  are  shown  to  involve 
Laplace  transforms  of  the  density  functions  of  the  service  time  distributions  and 
their  derivatives.  A  recursive  solution  for  the  mean  production  rate  is  obtained 
and  the  effect  of  balancing  is  discussed.  It  is  concluded  that  the  balanced  division 
of  buffer  capacity  is  not  optimum  for  an  unbalanced  system  and  slightly  higher 
buffer  capacity  is  needed  for  the  server  with  less  variable  service  time  distribution, 
and  the  effect  of  unbalancing  increases  with  the  difference  in  the  variabilities  of 
the  service  distributions.  When  service  distributions  are  different,  the  idling  times 
change  slightly  from  the  balanced  condition  with  a  greater  rate  of  change  at  the 
server  with  less  variable  service  time  distribution. 

[4]  A.G  Konheim  and  M.  Reiser,  “  A  queueing  model  with  finite  waiting  room  and 
blocking,”  J.  Assoc.  Comput  Mach.,  23,  pp.  328-341,  (1976). 

Model:  A  system  with  two  servers  in  tandem  and  a  finite  capacity  intermediate 
buffer  is  considered.  Service  times  are  assumed  independent  and  exponentially  dis¬ 
tributed.  There  is  a  Poisson  arrival  stream  to  an  infinite  capacity  buffer  in  front  of 
the  first  server  and  a  feedback  path  to  this  buffer  for  the  serviced  jobs  in  the  second 
server.  Immediate  blocking  strategy  is  assumed  . 

Measure:  Steady-state  probabilities  are  obtained. 

Method:  State  of  the  system  at  time  t  is  defined  by  the  pair  (X*,X|),  where  X l 
and  denotes  the  number  of  jobs  in  the  first  and  the  second  buffer  at  time  t, 
respectively.  Forward  equations  are  written  and  solved  for  the  steady  state  proba- 
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bilities  by  using  generating  functions.  Necessary  and.  sufficient  conditions  are  given 
for  the  stability  of  the  system.  Analytical  results  are  then  put  into  algorithmic  form 
and  some  special  cases  are  considered. 

[5]  A.B.  Clarke,  “A  two-server  queueing  system  with  storage  between  servers,” 
Math.  Rep.  50,  Western  Michigan  Univ.,  (1977). 

Model:  A  tandem  configuration  of  two  servers  with  independent  and  exponential 
service  distributions  is  considered.  There  is  a  finite  capacity  buffer  between  the 
servers.  Non-immediate  blocking  is  assumed  with  Poisson  arrivals  to  an  infinite 
capacity  buffer  in  front  of  the  first  server.  When  both  servers  are  idle  an  incoming 
job  goes  directly  to  the  second  server  whereas  if  the  second  server  is  busy  but  the 
first  one  is  not  the  idle  is  served  in  the  first  server  and  join  the  intermediate  buffer. 
When  a  service  completion  occurs  in  the  second  server,  all  jobs  in  the  intermediate 
buffer  including  the  one  that  is  blocked  in  the  first  server(if  any)  leave  the  system. 
If  at  the  time  of  a  service  completion  in  the  first  server  the  second  server  is  idle  the 
job  that  has  just  been  served  leaves  the  system. 

Measure:  Steady-state  probabilities  of  the  system  state  process  are  studied. 
Method:  A  system  state  process  is  defined  and  the  block  entries  of  the  generator 
matrix  is  written  explicitly.  Then  a  matrix  geometric  solution  is  given  for  the  steady 
state  probabilities  where  the  rate  matrix  is  obtained  as  the  minimal  solution  of  a 
third  order  matrix  equation.  Some  computational  methods  are  also  discussed. 

[6]  P.  Caseau  and  G.  Pujolle,  “  Throughput  capacity  of  a  sequence  of  transfer  lines 
with  blocking  due  to  finite  waiting  room,”  IEEE  Trans.  Software  Engrg.,  SE-5,  pp. 
631-642,  (1979). 

Model:  A  tandem  line  of  servers  with  independent  and  exponential  service  distribu¬ 
tions  is  considered.  The  servers  are  seperated  by  finite  capacity  buffers.  Immediate 
blocking  is  assumed  with  Poisson  arrivals  to  an  infinite  capacity  buffer  in  front  of 
the  first  server.  Extensions  to  the  models  where  service  times  depend  on  queue  sizes, 
and  models  that  involve  external  arrivals  to  intermediate  buffers  are  also  studied. 
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In  the  latter  case,  interarrivals  to  intermediate  buffers  are  assumed  to  be  Poisson 
and  all  have  same  parameter.  An  intermediate  arrival  is  rejected  if  the  buffer  is  full, 
and  if  accepted,  it  leaves  the  system  as  soon  as  its  service  is  completed. 

Measure:  Maximum  system  throughput  is  considered. 

Method:  The  tandem  line  is  replaced  by  several  isolated  M/M/l/N  queueing  sys¬ 
tems  with  equivalent  arrival  and  service  rates  by  using  the  equivalence  relations 
between  different  types  of  blocking  policies.  Recursive  relations  for  the  utilizations 
of  these  subsystems  are  obtained  and  saturation  conditions  are  given.  Exact  ex¬ 
pressions  for  the  maximum  throughput  is  given  for  the  case  when  there  are  only  two 
servers,  and  also  for  the  case  when  the  servers  are  identical  and  the  intermediate 
buffer  capacities  are  equal. 

[7]  F.G.  Foster  and  H.G.  Perros,  “  On  the  blocking  process  in  queueing  networks,” 
European  J.  Operations  Res.,  5,  pp.  276-283,  (1980). 

Models:  Three  different  models  that  involves  servers  with  exponential  service  times 
are  discussed.  In  the  first  model,  there  are  two  such  servers  in  tandem  with  a  finite 
capacity  intermediate  buffer  and  a  Poisson  arrival  stream  to  an  infinite  buffer  in 
front  of  the  first  server.  In  the  second  model,  there  are  several  servers  in  parallel  in 
the  first  stage  and  this  stage  is  in  tandem  with  a  single  server  with  no  buffer  space 
between  them.  There  are  Poisson  arrival  streams  to  infinite  capacity  buffers  in 
front  of  the  servers  in  the  first  stage.  Third  model  is  a  generalization  of  the  second 
model  where  there  are  two  such  models  in  parallel,  tandem  with  a  single  server, 
again  with  no  intermediate  buffer.  Non-immediate  blocking  strategy  is  adopted  in 
all  the  models. 

Measure:  Mean  blocking  time  is  considered. 

Results:  For  the  first  two  models  exact  expressions  for  mean  blocking  time  is 
obtained  for  cases  when  the  first  stage  servers  have  infinite  rates,  and  when  they 
have  minimum  rates  (to  insure  stability).  Also  conditions  for  the  stability  of  the 
system  are  given.  Only  approximate  results  are  given  for  the  third  model. 
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[8]  J.  Labetoulle  and  G.  Pujolle,  “  Isolation  method  in  a  network  of  queues,”  IEEE 
Trans.  Soft.  Engrg.,  SE-6,  pp.  373-381,  (1980). 

Model:  A  general  queueing  network  with  exponential  servers  and  finite  capacity  in¬ 
termediate  buffers  is  considered.  There  is  an  Poisson  arrival  process  to  the  network 
and  immediate  blocking  is  assumed. 

Method:  An  isolation  method  is  presented  where  the  network  is  subdivided  into 
several  subsystems  so  that  each  system  can  be  studied  independently.  The  method 
is  said  to  give  powerful  approximations  on  any  case  where  the  service  times  or  the 
arrival  rates  are  dependent  on  the  state  of  some  part  of  the  queueing  network. 

[9]  G.  Latouche  and  M.F.  Neuts,  “  Efficient  algorithmic  solutions  to  exponential 
tandem  queues  with  blocking,”  SIAM  J.  Alg.  Disc.  Meth.,  1,  pp.  93-106,  (1980). 

Model:  A  two  stage  tandem  system  separated  by  a  finite  capacity  intermediate 
buffer  is  considered.  There  are  r  identical  parallel  servers  in  the  first  stage  and  c 
identical  parallel  servers  in  the  second  stage.  All  the  servers  are  assumed  to  have 
independent  and  exponentially  distributed  service  times.  There  is  a  Poisson  arrival 
stream  to  an  infinite  capacity  buffer  in  front  of  the  first  stage.  Non-immediate 
blocking  strategy  is  adopted  but  also  full  blocking  of  all  the  first  stage  servers  is 
considered  in  that  when  r*  servers  in  stage  I  are  blocked  all  the  rest  are  also  blocked. 
After  full  blocking  of  stage  I  when  the  number  of  departures  at  stage  II  reaches  k*, 
all  the  servers  at  stage  I  resume  service  again. 

Measure:  Stedy-state  probabilities  for  the  joint  queue-length  distribution  are  con¬ 
sidered. 

Method:  A  system  state  process  is  defined  and  for  different  choices  of  r*  and 
k*  explicit  expressions  for  the  block  entries  of  the  generator  matrix  are  given.  A 
recursive  formula  for  the  stationary  probability  distribution  vector  is  obtained  by 
using  matrix-geometric  methods.  Some  extensions  and  variants  of  the  above  model 
are  briefly  mentioned. 
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[10]  H.G.  Perros,  “  A  symetrical  exponential  open  queue  network  with  blocking  and 
feedback,”  IEEE  Trans.  Software  Engrg.,  SE-7,  pp.  395-402,  (1981). 

Model:  A  two  stage  tandem  system  with  feedback  is  considered.  There  are  several 
servers  in  parallel  in  the  first  stage  and  only  a  single  server  in  the  second  stage. 
Identical  and  independent  Poisson  arrival  streams  to  infinite  capacity  buffers  in 
front  of  the  first  stage  servers  is  assumed.  All  the  servers  have  exponential  service 
distributions.  Immediate  blocking  of  a  first  stage  server  occurs  each  time  it  com¬ 
pletes  service  and  remains  blocked  until  the  job  that  it  last  served  completes  its 
service  in  the  second  stage  server. 

Measure:  Queue-lenght  distribution  is  studied. 

Method:  An  approximate  expression  for  the  probability  distribution  of  the  number 
of  blocked  first  stage  servers  is  obtained.  Based  on  this  distribution,  assuming 
processor  sharing  type  of  service,  an  approximate  expression  for  the  queue-length 
probability  distribution  is  derived. 

[11]  M.  Pinedo  and  R.W.  Wolff,  “  A  comparison  between  tandem  queues  with  de¬ 
pendent  and  independent  service  times,”  Operations  Res.,  30,  pp.  464-479,  (1982). 

Model:  Tandem  queueing  systems  with  exponential  servers  are  considered.  The 
service  times  are  either  independent  at  each  server  (case  I)  or  same  at  each  server, 
once  generated  according  to  an  exponential  distribution  (case  D).  Specifically,  a 
two  server  system  with  Poisson  arrivals  to  an  infinite  capacity  buffer  is  considered 
under  light  traffic  conditions  when  there  is  infinite  or  no  buffer  space  between  the 
servers.  Also,  tandem  configuration  of  servers  with  general  service  distributions 
with  an  infinite  supply  of  jobs  in  front  of  the  first  server  is  considered  with  infinite 
or  zero  capacity  intermediate  buffers. 

Measures:  Expected  waiting  time,  E(W),  mean  and  variance  of  departure  epoch 
of  a  customer,  E{U)  and  V(U),  respectively,  and  the  system  capacity,  A 3up,  is  com¬ 
pared  for  cases  (D)  and  (I).  Also  the  effect  of  service  regularity  on  the  performance 
of  the  system  is  considered. 
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Results:  For  the  two  server  case  both  E(W(D))  and  E(W(I))  is  computed  when 
there  is  an  infinite  capacity  intermediate  buffer  and  also  when  there  is  no  inter¬ 
mediate  buffer,  both  under  light  traffic.  It  is  concluded  that  under  light  traffic, 
average  waiting  time  in  case  (D)  is  greater  than  in  case  (I)  when  the  intermedi¬ 
ate  buffer  has  infinite  capacity.  Also  for  the  two  server  system  departure  epochs 
are  compared  and  it  is  shown  that  E(U(D))  <  E(U(I ))  for  infinite  capacity  in¬ 
termediate  buffer  and  E(U(D))  =  E(V(I))  and  V(U(D ))  >  V(U(I))  when  there 
is  no  intermediate  buffer.  Then,  for  a  tandem  configuration  which  involves  servers 
with  general  service  time  distributions,  expressions  for  X8Up  are  obtained.  For  the 
two  server  tandem  system  it  is  shown  that  \SUp(D )  —  A Sup{I),  while  for  a  general 
system  A SUp{D)  <  Asup(I),  provided  that  the  service  times  are  not  deterministic. 
Effect  of  service  time  regularity  on  the  performance  of  the  tandem  systems  is  also 
considered.  Variability  of  distribution  functions  is  defined  and  some  of  its  properties 
are  given.  It  is  shown  that  tandem  systems  that  involves  servers  with  less  variable 
service  time  distributions  has  a  larger  capacity  compared  to  ones  with  more  vari¬ 
able  service  time  distributions.  Based  on  both  analytical  and  simulation  results  it 
is  concluded  that  relative  performance  of  case  (I)  improves  as  (i)  arrival  rate  de¬ 
creases,  (ii)  arrival  process  becomes  more  regular,  and  (iii)  service  time  distribution 
becomes  less  regular. 

[12]  T.  Altiok,  “  Approximate  analysis  of  exponential  tandem  queues  with  blocking,” 
European  J.  Operations  Res.,  11  ,  pp.  390-398,  (1982). 

Model:  A  tandem  line  of  servers  with  independent  and  exponential  service  time 
distributions  and  finite  capacity  intermediate  buffers  is  considered.  Non-immediate 
blocking  is  assumed  with  Poisson  arrivals  to  an  infinite  capacity  buffer  in  front  of 
the  first  server. 

Measure:  An  approximate  algorithm  to  obtain  the  steady-state  probabilities  of 
the  queue  sizes  is  studied. 

Method:  A  decomposition  procedure  that  revises  the  service  time  distribution  at 
each  server  and  decomposes  the  system  into  isolated  simple  queueing  systems  is 
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presented.  Decomposition  is  done  by  ignoring  the  interactions  between  the  com¬ 
ponents  of  the  system.  Two  basic  assumptions  are  made;  (1)  the  input  process  to 
each  intermediate  buffer  is  assumed  to  be  Poisson,  and  (2)  the  blocking  of  a  server 
occurs  only  due  to  the  immediate  successor  buffer.  The  method  decomposes  the 
tandem  line  into  queueing  systems  of  the  type  M/C2/I/N,  where  C 2  denotes  a  two 
stage  Coxian  distribution.  A  Markov  chain  is  imbedded  by  looking  at  each  system 
at  departure  points.  Analytic  results  lead  to  systems  of  equations  which  are  solved 
by  iteration  techniques.  Numerical  results  and  some  extensions  are  mentioned. 

[13]  F.P.  Kelly,  “  The  troughput  of  a  series  of  buffers,”  Advances  in  Appl.  Proba¬ 
bility,  14,  pp.  633-653,  (1982). 

Model:  Messages  has  to  be  transmitted  through  a  tandem  channel  with  M  nodes. 
The  nodes  have  finite  but  equal  buffer  capacities.  Lengths  of  the  messages  are  i.i.d. 
with  a  known  common  distribution.  Time  taken  by  a  node  to  transmit  a  message 
(service  time)  is  proportional  to  its  message  length  and  a  given  message  has  same 
transmission  time  at  each  node.  Inputs  to  the  first  node  are  assumed  instantaneous. 
Both  immediate  and  non-immediate  blocking  are  discussed.  Also  the  model  when 
transmission  rates  of  a  message  at  different  nodes  are  not  equal  but  independently 
distributed  according  to  some  distribution  is  discussed. 

Measure:  Asymptotic  behavior  of  the  throughput  is  studied  as  the  number  of 
channels  increases. 

Results:  Throughput  is  defined  as  lim*_*oo  E( t),  where  Nt  is  the  number  of  mes¬ 
sages  which  have  been  transmitted  from  the  first  node  in  the  interval  [0,t] .  First,  the 
rate  at  which  the  intermediate  buffer  sizes  should  grow  to  ensure  that  the  through¬ 
put  does  not  decline  to  0  as  M  — >  00  is  investigated.  Then,  certain  monotonicity 
relations  between  throughputs  of  the  above  models  are  obtained.  Systems  with  no 
intermediate  buffers  are  used  to  provide  straightforward  bounds  on  the  degradation 
of  throughput  as  the  number  of  nodes  increase.  Then,  more  sophisticated  bounds 
are  obtained  to  see  the  effect  of  an  increase  in  the  buffer  size.  It  is  shown  that  for 
exponentially  distributed  message  lengths  either  the  transmission  capacity  or  the 
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buffer  size  should  grow  at  rate  log  M  and  for  distributions  with  tail  parts  propor¬ 
tional  to  x~p,  either  the  transmission  rate  should  grow  at  a  rate  Mp  or  the  buffer 

1 

size  should  grow  at  a  rate  M  to  ensure  that  the  throughput  does  not  decline 
to  zero  as  M  increase  to  infinity.  Therefore,  the  behavior  of  throughput  for  large  M 
is  determined  by  tail  part  of  the  distribution  function  of  the  message  lenghts. 

[14]  H.G.  Perros  and  T.  Altiok,  “  Approximate  analysis  of  open  networks  of  queues 
with  blocking:  Tandem  configurations,”  CS  Rep.  83-11,  NC  State  Univ.,  (1984). 

Model:  A  tandem  line  of  M  servers  with  independent  and  exponential  service 
distributions  and  finite  capacity  intermediate  buffers  is  considered.  Non-immediate 
blocking  is  assumed  with  Poisson  arrivals  to  an  infinite  capacity  buffer  in  front  of 
the  first  server.  The  case  with  Poisson  arrivals  to  a  finite  capacity  buffer  in  front 
of  the  first  server  is  also  considered. 

Measure:  An  approximate  algorithm  to  obtain  the  steady-state  probabilities  of 
the  queue  sizes  is  studied. 

Method:  Same  decomposition  method  as  in  [12]  is  used  but  assumption  (2)  is 
relaxed  and  it  is  allowed  to  have  blocking  backlogged  over  any  number  of  successive 
queues.  Input  process  to  each  queue  is  still  assumed  to  be  Poisson.  The  system  is 
again  decomposed  into  several  M/C/l/N  queueing  systems  in  isolation,  where  now 
for  the  ith  server  C  is  a  M  —  i  +  1  stage  Coxian  distribution,  for  1  <  i  <  M.  In 
the  case  when  first  buffer  has  finite  capacity  the  effective  arrival  rate  is  estimated 
by  successive  iterations.  Numerical  examples  are  given  and  it  is  reported  that  the 
approximation  is  better  for  balanced  systems. 

[15]  F.P.  Kelly,  “  Segregating  the  input  to  a  series  of  buffers,”  Math  Operations 
Res.,  10,  pp.  33-43,  (1985). 

Model:  Two  parallel  systems  of  the  type  described  in  [13]  is  considered.  The 
incoming  message  is  directed  into  one  of  the  two  systems  depending  on  its  length. 
Measure:  System  throughput  is  studied. 
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Result:  It  is  shown  that  by  using  two  systems  in  parallel,  one  dealing  with  long 
messages  and  the  other  with  short  messages  the  decay  of  throughput  with  the  num¬ 
ber  of  nodes  M  can  be  improved  from  ( logM)~l  to  ( loglogM )_1  when  the  message 

length  distribution  is  exponential,  and  when  the  message  length  distribution  is  such 

—  1 

that  its  tail  part  is  proportional  to  x~p,  with  p  >  1,  the  improvement  is  from  M  « 
to  M  p2  . 
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BREAKDOWN  MODELS 


[16]  M.C.  Freeman,  “  The  effects  of  breakdowns  and  interstage  storage  on  production 
line  capacity,”  J.  Industrial  Engrg .,  15,  pp.  194-200,  (1964). 

Model:  A  tandem  line  of  servers  with  constant  and  equal  production  times  is 
considered.  Non-immediate  blocking  is  assumed  with  infinite  supply  of  job  units 
in  front  of  the  first  server.  The  servers  are  subject  to  breakdown  only  when  they 
are  working  on  a  job.  Times  between  successive  breakdowns  and  the  duration  of 
breakdowns  are  all  assumed  to  be  independent  and  exponentially  distributed. 
Measure:  Efficiency  of  the  line  is  defined  as  where  Pr,{X)  is  the 

percentage  of  the  time  the  line  is  down  for  a  given  storage  capacity  X. 

Results:  First,  Pd{ 0)  and  Pd( oo)  are  calculated.  Then,  the  effect  of  system 
parameters  on  buffer  capacity  and  gain  efficiency  is  discussed  through  simulation 
results  for  three  stage  lines.  Some  general  guidelines  based  on  simulation  results 
are  given  for  storage  allocation. 

[17]  E.J.  Muth  “  A  method  for  predicting  system  downtime,”  IEEE  Trans,  on 
Reliability ,  17,  pp.  97-102,  (1968). 

Model:  A  single  machine  subject  to  breakdowns  is  considered.  It  is  assumed 
that  the  succesive  failure  and  repair  times  are  both  i.i.d  with  known  cumulative 
distribution  functions. 

Measure:  System  downtime  is  defined  as  the  time  the  system  is  down  during  the 
time  interval  (0,f)  and  is  denoted  by  D(t).  Approximate  distribution  of  D(t)  is 
obtained. 

Results:  It  is  shown  that  the  Beta  distribution  is  a  suitable  approximation  for 
the  conditional  distribution  of  given  that  at  least  one  failure  has  occured 

prior  to  time  t.  Mean  and  variance  of  D(t)  are  calculated  and  it  is  shown  that  the 
distribution  of  D(t)  approaches  to  Normal  distribution  for  large  values  of  t. 


131  - 


[18]  J.  Masso  and  M.L.  Smith  “  Interstage  storages  for  three  stage  lines  subject  to 
stochastic  failures,”  AIIE  Trans.,  6,  pp.  354-358,  (1974). 

Model:  A  tandem  line  of  three  servers  with  equal  and  constant  service  times  and 
independent  and  exponential  up  and  down  times  is  considered.  It  is  also  assumed 
that  there  is  an  infinite  supply  of  job  units  in  front  of  the  first  server. 

Measure:  System  utility  is  considered  as  a  performance  measure. 

Method:  Single  and  multiple  regression  techniques  are  used  to  approximate  the 
minimal  total  buffer  capacity  required  by  the  system  to  reach  its  maximal  possible 
level  of  system  utility.  Also  a  technique  to  allocate  a  given  quantity  of  total  storage 
among  individual  interstage  buffers  is  given. 

Results:  It  is  shown  through  simulations  that  when  system  utility  is  within  5% 
of  its  maximal  value  the  effect  of  increasing  the  buffer  capacity  on  system  utility 
becomes  insignificant. 

[19]  T.J.  Sheskin  “Allocation  of  interstage  storage  along  an  automatic  production 
line,”  AIIE  Trans.,  8,  pp.  146-152,  (1976). 

Model:  A  tandem  line  of  servers  with  constant  and  equal  production  times  is 
considered.  Immediate  blocking  is  assumed  with  infinite  supply  of  job  units  in 
front  of  the  first  server.  Times  between  successive  breakdowns  and  the  duration 
of  breakdowns  are  all  assumed  to  be  independent  and  exponentially  distributed. 
Failures,  repairs  and  transfer  of  jobs  are  all  synchronized  to  time  epochs. 
Measure:  Allocation  of  a  fix  total  storage  capacity  so  as  to  maximize  the  steady 
state  output  rate  is  considered. 

Method:  An  exact  compression  algorithm  is  given  by  considering  four  servers  in 
tandem.  Discussion  of  the  algorithm  and  guidelines  for  buffer  allocation  is  given. 
For  larger  systems  a  much  faster  approximate  decomposition  algorithm  is  given. 
The  algorithm  analyzes  each  server  seperately  by  ignoring  the  dependence  between 
the  arrivals  and  departures  to  a  node. 


132  - 


[20]  G.T.  Artamanov,  “  Productivity  of  a  two  instrument  discrete  processing  line 
in  the  presence  of  failures,”  Kibernatika  3,  pp.  126-130;  English  trans.  Cybernetics , 
12  ,  pp.  464-468  (1977). 

Model:  Two  servers  in  tandem  with  equal  and  constant  service  times  and  an  inter¬ 
mediate  finite  capacity  buffer  is  considered.  Immediate  blocking  is  assumed  with 
infinite  supply  of  job  units  in  front  of  the  first  server.  Times  between  successive 
breakdowns  and  the  duration  of  breakdowns  are  all  assumed  to  be  independent  and 
exponentially  distributed. 

Measure:  Mean  productivity  is  calculated  using  the  steady  state  probabilities. 
Method:  A  continuous  time  Markov  chain  is  considered  with  states  defined  by 
the  triple  (n,  £*1,0:2)  where  n  is  the  number  of  jobs  in  buffer  and  01,0:2  are  the 
up/down  indicators  for  the  first  and  second  server,  respectively.  Balance  equations 
for  the  steady  state  probabilities  are  written  explicitly  and  closed  form  solutions 
are  obtained. 

[21]  E.  Ignall  and  A.  Silver,  “  The  output  of  a  two-stage  system  with  unreliable 
machines  and  limited  storage,”  AIIE  Trans.,  9,  pp.  183-188,  (1977). 

Model:  A  two  stage  tandem  system  with  a  finite  intermediate  buffer  and  multiple 
servers  in  each  stage  is  considered.  The  servers  are  assumed  to  have  constant  and 
equal  service  times  and  independent  and  exponentially  distributed  failure  and  repair 
times.  Non-immediate  blocking  is  assumed  with  infinite  supply  of  job  units  in  front 
of  the  first  stage  servers. 

Measure:  Estimating  hourly  line  output  by  a  computationally  simple  heuristic 
procedure  is  discussed. 

Method:  First,  the  model  with  a  single  server  in  each  stage  is  considered  and 
approximate  line  output  is  obtained  by  using  known  results  for  zero  and  infinite 
buffer  capacities.  Then,  for  multiple  servers  each  stage  is  modelled  as  a  single  server 
with  rate  equal  to  the  sum  of  the  individual  rates  of  the  servers.  An  approximate 
formula  for  hourly  line  output  is  obtained  as  in  the  first  case. 
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[22]  K.  Okamura  and  H.  Yamashina,  “  Analysis  of  the  effect  of  buffer  storage  ca¬ 
pacity  in  transfer  line  systems,”  AIEE  Trans.,  9,  pp.  127-135,  (1977). 

Model:  A  line  with  two  servers  in  tandem  and  a  finite  intermediate  buffer  is 
considered.  The  servers  are  assumed  to  have  constant  and  equal  service  times,  and 
independent  and  geometrically  distributed  failure  and  repair  times.  Non-immediate 
blocking  is  assumed  with  infinite  supply  of  jobs  in  front  of  the  first  server. 
Measure:  The  effect  of  buffer  capacity  on  production  rate  and  the  mean  number 
of  jobs  in  the  buffer  is  considered. 

Results:  The  states  of  the  system  and  the  corresponding  47V+6  by  4iV+6  transition 
matrix  are  explicitly  written  and  the  balance  equations  are  solved  for  steady-state 
probabilities  for  several  values  of  system  parameters.  Graphs  for  production  rate 
and  the  mean  number  of  jobs  in  the  buffer  are  illustrated  as  a  function  of  the 
intermediate  buffer  capacity.  A  classification  of  these  graphs  are  made.  The  effect 
of  variations  in  production  times  for  unbalanced  systems  is  considered.  It  is  argued 
that  the  difference  between  the  breakdown  rates  reduces  the  effect  of  installing 
buffer  while  the  difference  between  the  repair  rates  does  not  and  although  the  effect 
of  interchanging  the  servers  is  negligible,  for  large  differerences  it  is  better  to  put 
the  faster  server  in  front. 

[23]  J.A.  Buzacott  and  L.E.  Hanifin,  “  Models  of  automatic  transfer  lines  with 
inventory  banks-  A  review  and  comparison,”  AIIE  Trans.,  10  ,  pp.  197-207,  (1978). 

Model:  Compares  the  assumptions,  method  of  derivation  and  the  results  of  pa¬ 
pers  by  Vladziewski/Sevastyanov,  Koenigsberg,  Buzacott  and  Sheskin  for  two  stage 
blocking  models  with  independent  and  exponentially  distributed  service,  up  and 
down  times  as  common  assumptions.  The  major  difference  in  the  assumptions  is 
whether  the  idling  machines  can  fail  or  not. 

Measure:  Line  efhcieny  is  compared  for  these  models. 

Results:  In  this  mostly  qualitative  paper  validity  of  the  assumptions  are  tested 
by  a  real  data  from  a  transfer  line  and  the  predictions  of  the  analytical  models 
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are  compared  with  a  simulation  model  which  uses  the  actual  data.  The  difference 
between  analytical  and  simulation  models  is  reported  to  be  significant. 

[24]  R.A.  Murphy,  “  Estimating  the  output  of  a  series  production  system,”  AIEE 
Trans.,  10,  pp.  139-148,  (1978). 

Model:  A  tandem  line  of  servers  with  finite  capacity  intermediate  buffers  between 
some  of  the  servers  is  considered.  Up  and  down  times  are  assumed  mutually  in¬ 
dependent  with  exponential  and  general  distributions,  respectively.  The  servers  are 
assumed  to  have  constant  but  different  service  times.  The  failures  are  assumed  op¬ 
eration  dependent  and  no  simultaneous  repairs  are  permitted  as  there  is  a  certain 
priority.  Non-immediate  blocking  is  assumed  with  infinite  supply  of  job  units  in 
front  of  the  first  server. 

Measure:  Expected  output  rate  is  considered. 

Method:  First,  results  for  a  tandem  line  with  no  intermediate  buffers  are  obtained. 
Then  the  case  when  there  is  only  one  intermediate  buffer  in  the  line  is  discussed 
by  considering  the  servers  in  front  of  the  buffer  as  an  input  block  and  the  ones 
after  the  buffer  as  an  output  block.  Effective  (relative)  up  and  down  times  are 
calculated  analytically  by  viewing  the  effect  of  the  buffer  to  increase  the  up  time 
and  decrease  the  down  time  of  the  output  block  as  seen  by  the  input  block.  Then, 
approximations  are  made  to  simplify  the  calculations  so  that  sensitivity  analysis 
and  numerical  optimization  can  be  performed.  The  results  are  applied  to  the  case 
where  there  are  more  than  one  intermediate  buffer  in  the  line  by  considering  the 
effect  of  each  buffer  and  finding  the  equivalent  up  and  down  times  of  the  downstream 
servers,  whence  eliminating  the  buffers. 

[25]  Y.C.  Ho,  M.A.  Eyler  and  T.T.  Chien,  “  A  gradient  technique  for  general  buffer 
storage  design  in  a  production  line,”  Proc.  17th  IEEE  Conf.  on  Control  and  Deci¬ 
sion,  pp.  625-632,  (1978). 

Model:  A  tandem  line  of  servers  with  constant  but  different  production  times  is 
considered.  Non-immediate  blocking  is  assumed  with  infinite  supply  of  job  units  in 
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front  of  the  first  server.  Times  between  successive  breakdowns  and  the  duration  of 
breakdowns  are  all  assumed  to  be  independent  and  exponentially  distributed. 
Measure:  Allocation  of  a  given  total  buffer  capacity  to  intermediate  buffers  to 
maximize  the  efficiency  of  the  line  is  considered. 

Method:  First,  the  forced-down  state  of  a  server  is  classified  as  irreducible  (caused 
by  intrinsic  differences  in  production  rates  of  the  servers)  or  reducible  force-downs  ( 
caused  by  random  failures  of  the  servers).  An  algorithm  that  computes  the  sensitiv¬ 
ity  (gradient)  of  the  increase  of  line  production  per  unit  increase  in  buffer  capacity 
at  a  buffer  location  and  then  allocates  a  buffer  size  to  each  location  by  a  hill  climb¬ 
ing  procedure  until  all  gradients  become  equal  is  presented  and  simulation  results 
are  displayed.  In  comparison  with  the  brute  force  gradient  approach,  the  algorithm 
can  generate  the  gradients  of  all  buffers  in  a  single  simulation  run. 

[26]  S.B.  Gershwin  and  M.  Ammar,  “  Reliability  in  flexible  manufacturing  systems,” 
Proc.  18th  IEEE  Conf.  on  Control  and  Decision ,  pp.  540-545,  (1979). 

Model:  Tandem  and  merge  configurations  are  considered  for  systems  with  three 
servers.  Both  deterministic  and  exponential  service  time  distributions  are  consid¬ 
ered.  Repair  and  failure  times  are  assumed  either  geometric  or  exponential  and 
independent  from  the  state  of  the  system.  Failures  are  assumed  operational  in  that 
the  servers  can  only  fail  when  working  on  a  job.  Non-immediate  blocking  is  consid¬ 
ered  with  infinite  supply  of  jobs  in  front  of  the  first  server. 

Measure:  Steady  state  probabilities  are  considered. 

Methods:  For  tandem  systems  a  state  process  is  defined  and  the  state  transition 
equations  are  written  for  the  internal  states  both  for  exponential  and  deterministic 
(and  equal)  service  times.  Also  transition  equations  for  a  merge  configuration  are 
written  for  the  internal  states  and  they  are  shown  to  be  similar  to  the  equations  for 
the  tandem  model.  Comparisons  and  some  speculations  are  made  for  more  complex 
merge  configurations.  In  all  cases  steady-state  probabilities  for  the  internal  states 
are  assumed  to  be  in  sum-of-products  form. 
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[27]  J.  Wijngaard,  “  The  effect  of  interstage  buffer  storage  on  the  output  of  two 
unreliable  production  units  in  series,  with  different  production  rates,”  AIIE  Trans., 
11,  pp.  42-47,  (1979). 

Model:  A  line  with  two  servers  in  tandem  and  a  finite  intermediate  buffer  is 
considered.  The  servers  are  assumed  to  have  constant  but  different  service  times 
and  independent  and  exponentially  distributed  failure  and  repair  times.  Immediate 
blocking  is  assumed  with  infinite  supply  of  job  units  in  front  of  the  first  server. 
The  main  difference  from  the  other  models  is  that  the  job  units  are  modelled  as  a 
continuous  random  variable  rather  than  being  discrete. 

Measure:  System  production  rate  is  considered. 

Method:  The  state  of  the  system  is  defined  as  in  [20].  Regeneration  points  are 
identified  as  enterence  points  to  states  that  corresponds  to  empty  buffer  and  a  cycle 
is  defined  as  the  time  between  subsequent  regenerations.  Production  rate  is  defined 
as  quotient  of  the  expected  production  per  cycle  and  the  expected  duration  of  that 
cycle.  For  equal  production  rates,  this  lead  to  a  differential  equation  and  is  solved 
explicitly.  For  different  production  rates,  the  problem  gave  rise  to  a  system  of 
three  differential  equations  and  only  the  form  of  the  solution  is  given  in  this  case. 
Simulation  results  for  the  effect  of  buffer  on  an  unbalanced  line  are  also  briefly 
discussed. 

[28]  A.L.  Soyster,  J.W.  Schmidt  and  M.W.  Rohrer,“  Allocation  of  buffer  capacities 
for  a  class  of  fixed  cycle  production  lines,”  AIEE  Trans.,  11,  pp.  140-146,  (1979). 

Model:  A  tandem  line  of  servers  with  finite  buffers  between  the  servers  is  consid¬ 
ered.  The  servers  are  assumed  to  have  constant  but  different  service  times.  Down 
time  distribution  of  each  server  is  assumed  to  be  an  independent  Bernoulli  process, 
i.e.,  the  probability  that  server  i  is  down  during  a  given  cycle  is  p;,  independent  of 
the  state  of  all  other  servers  and  previous  state  of  server  i.  Non-immediate  blocking 
is  assumed  with  infinite  supply  of  job  units  in  front  of  the  first  server. 

Measure:  Allocation  of  a  given  set  of  buffer  capacities  to  maximize  the  steady 
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state  output  rate  is  considered. 

Method:  The  problem  is  formulated  as  a  nonlinear  programming  problem  where 
the  form  of  the  objective  function  is  not  known.  Objective  function  is  approximated 
by  using  lower  and  upper  bounds.  First,  for  a  two  server  system  an  exact  expression 
is  obtained.  Then,  for  the  general  case  approximate  expressions  are  obtained  by 
using  two  server  subsystems.  Upper  and  lower  bounds  are  established  for  the  steady- 
state  system  output,  and  certain  concave,  seperable  programs  are  formulated  to 
determine  the  optimal  buffer  capacities.  Simulations  showed  that  the  objective 
function  that  is  obtained  through  approximations  is  insensitive  to  modest  changes 
in  capacity  allocation.  Also,  it  is  concluded  that  larger  buffers  should  be  allocated 
around  servers  with  lower  reliability. 

[29]  S.B.  Gershwin  and  O.  Berman,  “  Analysis  of  transfer  lines  consisting  of  two 
unreliable  machines  with  random  processing  times  and  finite  storage  buffers,”  AIIE 
Trans.,  13  ,  pp.  2-11,  (1981). 

Model:  A  line  with  two  servers  in  tandem  with  exponential  service  times  and  finite 
capacity  intermediate  buffer  is  considered.  Immediate  blocking  is  assumed  with 
infinite  supply  of  job  units  in  front  of  the  first  server.  The  servers  are  subject 
to  breakdown  only  when  they  are  working  on  a  job.  Times  between  successive 
breakdowns  and  the  duration  of  the  breakdowns  are  all  assumed  to  be  independent 
and  exponentially  distributed. 

Measures:  System  production  rate,  utilization  and  average  in-process  inventory 
are  considered. 

Method:  A  continuous  time  Markov  chain  is  considered  with  states  defined  as  in 
[20],  Explicit  expressions  for  steady  state  probabilities  of  the  states  are  found  by 
using  balance  equations  and  assuming  product-form  solutions.  Then,  these  proba¬ 
bilities  are  used  to  calculate  the  above  performance  measures.  These  measures  are 
displayed  as  a  function  of  the  productivity  of  each  server  and  limiting  behaviors  are 
obtained. 

Results:  The  existence  of  a  saturation  effect  is  illustrated  through  numerical  ex- 


-  138  - 


amples.  The  system  saturates  after  a  point  in  the  sense  that  no  further  increase  in 
the  speed  of  the  first  server  can  improve  the  productivity  of  the  system.  It  is  illus¬ 
trated  that  the  system’s  production  rate  increases  as  the  productivity  of  the  servers 
increase.  Also,  the  average  in-process  inventory  increases  as  the  first  server  becomes 
more  productive  and  decreases  as  the  second  server  becomes  more  productive. 

[30]  E.J.  Muth  and  S.  Yeralan,  “  Effect  of  buffer  size  on  productivity  of  work  stations 
that  are  subject  to  breakdowns,”  Proc.  20th  IEEE  Conf.  on  Decision  and  Control, 
pp.  643-648,  (1981). 

Model:  A  line  with  two  servers  in  tandem  and  a  finite  intermediate  buffer  is 
considered.  The  servers  are  assumed  to  have  constant  and  equal  service  times  and 
independent  and  exponentially  distributed  failure  and  repair  times.  The  servers  can 
only  breakdown  when  working  on  a  job.  Non-immediate  blocking  is  assumed  with 
infinite  supply  of  jobs  in  front  of  the  first  server. 

Measure:  Variation  of  productivity  with  the  intermediate  buffer  capacity  is  con¬ 
sidered. 

Method:  A  system  state  process  is  defined  and  4N+8  states  are  identified,  where 
N  is  the  capacity  of  the  intermediate  buffer.  The  states  are  ordered  in  such  a  way 
so  that  the  transition  matrix  has  a  block  tridiagonal  structure  with  4  by  4  blocks. 
This  structured  form  leads  to  the  solution  of  the  steady-state  probabilities  by  suc¬ 
cessively  solving  a  system  of  4  simultaneous  equations.  Moreover,  probabilities  for 
internal  states  are  shown  to  have  a  scalar  geometric  property.  Specifically,  if  X  is  the 
random  variable  that  denotes  the  number  of  jobs  in  the  buffer  at  steady-state  then 
P(X  =  k)  =  XkP(X  =  1),  for  1  <  k  <  N,  where  the  scalar  A  is  an  eigenvalue  of  a 
4  by  4  matrix.  Therefore,  the  probabilities  are  geometrically  increasing  or  decreas¬ 
ing  depending  on  the  availabilities  of  individual  servers.  The  system  production 
rate  is  calculated  by  using  these  probabilities.  Therefore,  for  any  buffer  size  the 
computation  of  the  production  rate  is  equally  simple.  In  general  production  rate 
depends  on  several  system  parameters  but  in  order  to  study  the  behavior  of  the 
system  production  rate  as  a  function  of  the  intermediate  buffer  capacity  a  simpler 
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approximate  expression  for  the  production  rate  that  only  depends  on  the  buffer 
capacity  is  given  by  an  empirical  formula.  This  empirical  formula  is  reported  to  be 
correct  up  to  10~10  over  a  wide  range  of  parameters. 

[31]  T.  Ohmi,  “  An  approximation  for  the  production  efficiency  of  automated  trans¬ 
fer  lines  with  in-process  storage,”  AIEE  Trans.,  13,  pp.  22-28,  (1981). 

Model:  A  tandem  line  of  servers  with  constant  and  equal  service  times  and  finite 
capacity  intermediate  buffers  is  considered.  Each  server  is  composed  of  stations 
that  are  mechanically  interlocked  where  each  station  is  assumed  to  have  a  constant 
probability  of  breaking  down.  A  server  can  only  breakdown  when  working  on  a 
job  and  it  breaksdown  when  one  of  its  stations  breakdown.  Repair  times  of  each 
station  are  i.i.d.  with  common  exponential  distribution.  Two  further  assumptions 
are  made;  (i)  only  one  server  can  be  down  at  a  given  time,  and  (ii)  at  the  time 
when  a  server  breaksdown  the  number  of  stocked  jobs  in  each  buffer  equals  its 
line-averaged  value,  i.e.,  fluctuations  of  in-process  inventories  are  ignored. 
Measure:  Production  efficiency  and  capacity  allocation  are  considered. 

Method:  First,  lifetime  of  each  server  is  shown  to  have  geometric  distribution. 
Then,  a  method  for  approximating  the  line  efficiency  is  developed.  Also,  the  opti¬ 
mal  partitioning  of  the  line  and  the  method  of  allocating  capacities  for  buffers  are 
numerically  investigated. 

[32]  M.F.  Neuts,  “A  queue  with  server  breakdowns  and  repairs”  in  Matrix- geometric 
solutions  in  stochastic  models  -  An  algorithmic  approach,  The  John  Hopkins  Univ. 
Press,  pp.  274-286,  (1981). 

Model:  A  system  with  N  parallel  servers  with  exponential  service  times  and  Pois¬ 
son  arrivals  to  an  infinite  capacity  buffer  whose  rates  may  depend  on  the  number 
of  operative  servers  is  considered.  Times  between  successive  breakdowns  and  the 
duration  of  the  breakdowns  are  all  assumed  to  be  independent  and  exponentially 
distributed.  It  is  assumed  that  there  are  C  repairmen  ( C  <  N )  available. 
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Measure:  Computation  of  steady  state  probabilities  is  considered. 

Method:  The  states  of  the  system  are  defined  and  the  generator  matrix  is  given. 
The  state  transition  process  is  shown  to  be  a  Quasi  Birth  and  Death  (QBD)  pro¬ 
cess.  For  N=1  (M/M/1  queue)  the  steady-state  probabilities  are  given  explicitly. 
For  the  general  case,  recursive  equations  for  the  steady-state  probabilities  are  ob¬ 
tained  by  matrix  geometric  methods  and  a  numerical  algorithm  is  briefly  discussed. 
Also,  computation  of  the  conditional  working  time  distribution  is  discussed  and  a 
numerical  example  is  given. 

[33]  T.  Altiok  and  S. Stidham,  Jr.  “  A  note  on  transfer  lines  with  unreliable  ma¬ 
chines,  random  processing  times  and  finite  buffers,”  HE  Trans .,  14,  pp.  125-127, 
(1982). 

A  comment  to  the  effect  that  except  the  two  node  models  the  two  type  of  blocking 
strategies  (immediate  and  non-immediate)  are  not  equivalent  and  it  is  necessary  to 
insert  a  blocking  indicator  into  the  state  description  to  study  models  which  adopt 
non-immediate  blocking  strategy. 

[34]  T.  Altiok  and  S.  Stidham,  Jr.  “  The  allocation  of  interstage  buffer  capacities 
in  production  lines,”  HE  Trans.,  15  ,  pp.  292-299,  (1983). 

Model:  A  tandem  line  of  servers  with  independent  and  exponentially  distributed 
service,  breakdown  and  repair  times  is  considered.  Non-immediate  blocking  is  as¬ 
sumed  with  infinite  supply  of  job  units  in  front  of  the  first  server. 

Measures:  Optimal  allocation  of  buffer  capacities  to  maximize  the  average  output 
rate  is  considered. 

Method:  It  is  shown  that  the  effective  service  completion  time  has  two  stage 
Coxian  type  distribution,  whence  the  system  is  transformed  into  a  tandem  line  of 
reliable  servers  with  two  stage  Coxian  service  distributions.  States  of  a  continuous 
time  Markov  chain  are  defined  and  the  balance  equations  are  solved  by  using  the 
power  method.  A  search  technique  for  optimal  buffer  allocation  is  also  discussed. 
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[35]  S.B.  Gershwin  and  I.C.  Schick,  “  Modelling  and  analysis  of  three-stage  transfer 
lines  with  unreliable  machines  and  finite  buffers,  ”  Operations.  Res.,  31,  pp.  354- 
380, (1983). 

Model:  A  tandem  configuration  of  servers  with  constant  and  equal  service  times  is 
considered.  Failure  and  repair  times  are  assumed  geometric  and  independent  from 
the  state  of  the  system.  Failures  are  assumed  operational  in  that  servers  can  only 
fail  when  working  on  a  job.  Non-immediate  blocking  is  considered  with  infinite 
supply  of  jobs  in  front  of  the  first  server. 

Measures:  In-process  inventory  and  efficiency  (production  rate)  are  considered. 
Methods:  The  states  are  defined  as  in  [20]  and  sum-of-products  form  solution  is 
assumed  for  the  steady-state  probabilities  of  the  internal  states.  For  the  boundary 
states,  expressions  for  the  steady-state  probabilities  are  derived  by  using  the  transi¬ 
tion  equations.  Therefore  the  order  of  the  system  is  reduced  from  TV2  to  N,  where 
N  is  the  total  buffer  capacity.  Although  the  order  is  reduced  the  new  system  is 
not  sparse  and  it  may  also  become  ill-conditioned.  The  general  results  are  applied 
to  a  system  with  three  servers,  transient  and  boundary  states  are  identified  and  a 
procedure  is  discussed  for  the  solution  of  steady-state  probabilities. 

Results:  The  following  results  based  on  simulations  are  given  for  three  server 
systems. 

-  Total  average  in-process  inventory  is  proportional  to  the  failure  rate  of  the  third 
server  and  inversely  proportional  to  the  failure  rate  of  the  second  server. 

-  Efficiency  increases  with  the  total  storage  size,  but  so  does  the  error  in  the  calcu¬ 
lations  of  the  steady-state  probabilities. 

-  Efficiency  stays  approximately  constant  when  all  probabilities  are  multiplied  by  a 
constant  number  and  the  storage  capacity  is  divided  by  the  same  number. 

-  Production  rate  is  not  affected  by  the  reversal  of  the  data  describing  the  system 
while  the  error  in  the  numerical  calculations  is. 

-  For  a  balanced  line,  maximum  efficiency  is  obtained  when  the  intermediate  buffers 
have  equal  capacities. 

-  When  last  machine  is  almost  reliable,  the  system  behaves  like  a  two-server  system. 
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[36]  B.  Vinod,  “  Unreliable  queueing  systems,”  IE  Working  Paper,  83-105, Dept,  of 
Industrial  Engrg.  Rutgers  Univ.,  (1983). 

Model:  Both  a  single  server  and  several  identical  servers  in  parallel ,  subject  to  ran¬ 
dom  breakdowns  and  repairs  are  considered.  Since  the  servers  are  in  parallel  there 
is  no  blocking.  System  is  modelled  as  a  multiple  customer  class  priority  queueing 
system.  Finite  source  of  failure  customers  have  pre-emptive  resume  priority  over 
the  job  customers,  and  a  queue  of  breakdowns  is  not  permissible.  Arrival  process 
of  failure  customers  are  Poisson  whose  rate  depends  on  the  number  of  operative 
servers.  Service  times  for  failure  customers  (repair  times)  are  exponentially  dis¬ 
tributed.  Both  operational  and  time  dependent  breakdowns  are  discussed  for  the 
single  server  case.  In  the  latter  case,  extensions  to  multiple  servers  are  also  done. 
Measures:  Steady-state  probabilities,  marginal  queue  length  distribution  and  its 
moments,  covariance  between  failure  and  job  class  customers,  utilizations  and  mean 
waiting  times  are  considered. 

Method:  By  lexicographically  ordering  the  states,  a  continuous  time  Markov  pro¬ 
cess  with  a  block  tri-diagonal  transition  matrix  (a  QBD  process)  is  obtained.  The 
stationary  probability  vector,  x,  of  the  process  is  partitioned  into  vectors  Xi  and 
it  is  shown  that  these  vectors  have  matrix- geometric  form,  i.e.,  X{  —  xq R,  where 
the  irreducible,  nonnegative  rate  matrix  R  is  the  minimal  solution  to  a  non-linear 
matrix  equation.  A  recurrence  relation  is  given  to  compute  R.  For  the  single  server 
case  R  and  xo  are  obtained  explicitly.  For  multiple  servers  x0  is  shown  to  be  the 
solution  of  a  system  of  linear  equations.  In  both  cases  expressions  for  the  above 
performance  measures  are  obtained. 

[37]  T.  Altiok,  “  Approximate  analysis  of  production  lines  with  general  service  and 
repair  times  and  with  finite  buffers,”  IE  Rep.  84-4,  Rutgers  Univ,  (1984). 

Model:  A  tandem  line  with  finite  capacity  buffers  between  the  servers  is  considered. 
The  servers  are  assumed  to  have  independent  Erlang  service  time  distributions.  The 
up  time  distribution  is  assumed  to  be  exponential  while  the  down-time  has  a  general 


distribution.  Both  infinite  supply  of  job  units  in  front  of  the  first  server  and  the 
case  where  there  is  a  Poisson  arrival  stream  to  an  infinite  buffer  in  front  of  the  first 
server  is  considered  with  non-immediate  blocking  assumption. 

Measures:  Average  number  of  jobs  in  each  buffer  and  utilization  of  each  server  is 
considered. 

Method:  Although  an  expression  for  the  cumulative  distribution  of  service  com¬ 
pletion  time  is  obtained,  it  is  very  complicated  to  deal  with.  However,  in  the  case 
of  exponential  repair  times,  by  observing  the  corresponding  Laplace-Stieltjes  trans¬ 
forms  it  is  seen  that  the  service  completion  time  distribution  is  the  sum  of  several 
two-stage  phase-type  distributions.  Then,  a  cumulative  distribution  function  is  ob¬ 
tained  by  assuming  that  at  most  one  breakdown  may  occur  during  the  process  time 
of  a  job.  In  this  way  failures  are  incorporated  into  the  service  completion  times 
which  are  approximated  by  specific  phase- type  distributions.  For  this  approxima¬ 
tion  by  phase-type  distributions,  first  two  or  three  moments  of  the  derived  service 
time  distribution  is  used.  Particular  mixtures  of  the  sum  of  exponential  distribu¬ 
tions  are  chosen  by  empirical  observations.  Then,  by  using  the  results  of  Perros 
and  Altiok  [14],  the  effective  service  of  the  ith  server  is  represented  with  a  phase 
structure  involving  2  X  (M  —  i  +  l)  phases,  where  M  is  the  total  number  of  nodes 
in  the  system.  Numerical  examples  and  some  empirical  observations  are  also  given. 

[38]  B.  Vinod  and  M.  Sabbagh,  “  Optimal  performance  analysis  of  manufacturing 
systems  subject  to  tool  availability,”  preprint,  (1984). 

Model:  A  closed  network  of  N  jobs  and  M  servers  with  exponential  service  times 
is  considered.  Routing  probabilities  are  assumed  to  be  independent  from  the  state 
of  the  system.  It  is  assumed  that  a  job  can  be  processed  only  if  a  tool  is  available 
and  each  server  requires  only  one  tool  to  process  a  job.  The  server  is  assumed  down 
if  a  tool  is  not  available.  Up  and  down  times  of  the  servers  are  assumed  to  be 
exponentially  distributed. 

Measure:  Optimal  allocation  of  spare  tool  classes  is  discussed. 

Method:  The  processing  rate  is  modified  to  capture  the  interruptions  caused  by 
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tool  failures.  Known  results  are  then  applied  to  these  approximate,  new  processing 
times  to  obtain  joint  queue  length  distributions.  Then,  the  problem  of  optimal  allo¬ 
cation  of  spare  tools  at  each  server  is  formulated  as  a  nonlinear  integer  programming 
problem.  An  algorithm  is  given  to  solve  this  mathematical  programming  problem. 
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